comma after a clause's verb or subject

What this neuron does

This neuron fires on a comma that comes right after a verb or a subject, where the sentence is about to continue with a new clause, such as "and, later" or "who, while she lived". Turned up, the model produced repeated "with" phrases, and turned down it produced strange word chains.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   3200 BC, when there was a small settlement on the bank of the Nile where Karnak now stands. The great temple complex at Karnak is, however, mostly a Middle Kingdom creation. Archaeological excavation reveals that the complex was

2. #2 peak

   the people of Novgorod to rule that city (c. 862); the Rurik princes maintained their control over Kievan Rus and, later, Muscovy until 1598.⏎Rurik’s

3. #3 peak

   and the wife of a future prime minister of the United Kingdom, Primrose was in her day the wealthiest woman in Britain, and an astute political observer who, while she lived, played a key role in advancing her husband’s career.⏎Like

4. #4 peak

   Hebrides that Columba turned his face when he accepted the terrible penance of Molaise. He bade farewell to his relatives, and, with a few monks who insisted on accompany him whithersoever he might

5. #5 peak

   amusement.⏎There was a half-decayed log lying by the roadside, and Grant sat down on it, calmly pulled a cigar from his cigar case, and, requesting one of his staff who stood nearby to furnish him a sheet of paper,

6. #6 peak

   interests would be better served, he continued, if Japan instead of Russia eventually dominated Korea.⏎Kennan urged the secretary to reign in General Douglas MacArthur, who, he wrote, had “wide and relatively uncontrolled latitude… in determining our policy

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   has allowed me to have fun in life, to go to school, and to make a choice in life. I can watch a movie, or I don’t have to. I could hang out with my friends or I could hang out with

2. #2 peak

   and answering the questions using the text.⏎Please read the sheet below ‘All About Lighthouses’ and then answer the questions below. Please remember, your answers need to be in full sentences and using your cursive handwriting and correct punctuation (cap

3. #3 peak

   felt animals are chosen, another list would drop down showing the bag with 50 animals and then, the bag with 100 animals. The same can be done for handmade coats. You might

4. #4 peak

   toward protecting family members from the risks of fire. This includes installing smoke detectors, keeping fire extinguishers charge, and establishing an emergency plan in case family members need to exit the house quickly if a fire starts.⏎However, fewer people know how

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.