comma after a sentence subject

What this neuron does

This neuron fires on a comma that comes straight after the subject of a sentence, such as 'Nicolas Sarkozy,' or 'Rural girls,', and before the verb comes. Turning it up gave text that was not clearly related to this.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   posited answers to this question, whether directly - in the case of Plato and Plotinius - or through story - in the case of Homer.⏎Plotinus, having been a proponent of Platonism, naturally concurs with Plato,

2. #2 peak

   François Mitterand who, in 1954, defiantly pronounced that ‘L’Algérie, c’est la France’. Nicolas Sarkozy, on the other hand, dramatically distanced himself both from Chirac and from

3. #3 peak

   Manhattan Project, decided that they would declare an American monopoly over the atom.⏎Logically enough, support for this idea was not universally shared. Great Britain and France, two nations with long histories of nuclear science and technology were determined to make progress in

4. #4 peak

   four years.⏎The disparity is partly due to the immense impact of rural students (by comparison, the urban poor are in school for over six years). Rural girls, however, get only three years of education, on average.⏎While there are a

5. #5 peak

   influence of the ducal court and supporters of the powerful bishops of Toul, Metz and Verdun. Numerous artists came from Flanders, Germany and, sometimes, Italy to work for the Dukes of Lorraine and their friends.

6. #6 peak

   decade and perhaps longer, the growth path and survival rate of new businesses means they are generating fewer new jobs.⏎The businesses that started in 2009, for example, are on course to create 1 million fewer jobs in the next

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   may be happy with a confidence level of 95 percent (giving a margin error of 0.05), or you may require a tighter accuracy of a 98 percent confidence level (a margin of error

2. #2 peak

   (both images from Fri Aug 9 2019)⏎“Similar particles have been detected near Saturn, suggesting⏎that the process is at work there as well,” says Liu. “Indeed,” adds⏎Angelopoulos, “this type

3. #3 peak

   upon it) wreaks may not be the only way that complexity grew.⏎Protein flaws called “dehydrons” may have made proteins less stable in water and made them more likely to end up working together, building up complex function.⏎Michael

4. #4 peak

   which can significantly increase a person’s risk of developing diabetes, he says.⏎However, there is evidence that if you lose weight, you have fewer dying fat cells and significantly fewer fat-engorged macrophages, Green

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.