comma after a finished clause

What this neuron does

This neuron fires on a comma that comes right after a complete phrase or sentence part, where more text is expected to follow, like a comma before a quote, a 'and why?' or a trailing 'sir,'. When it was turned up, the model's writing fell into repeated filler like 'the, that, the'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   .⏎That’s right: our phones got so smart they began putting pay phones out of business.⏎“Do you see the cell phone as sort of an arriviste, as someone that sort of came along and stole the thunder of the payphone?”

2. #2 peak

   religion until after the eleventh century, at which time it shared many features in common with Buddhism. Before that, the pre-Buddhist native tradition of Tibet, sometimes confusingly

3. #3 peak

   social group - a caste or community or religious minority, say - which can be counted on to back a specific party or candidate consistently. But who coined the term, and how did it come into use? This column by Ramachandra Guha

4. #4 peak

   His mind and body seemed two separate things and the young soldier couldn’t stand at attention or even offer a salute. “I-I guess I can’t take it, sir,” Kuhl said.⏎The general’s already-flushed face grew crimson.

5. #5 peak

   When it was over, DeMille yelled, “Cut!” and turned to his assistant, all smiles. “That was great!” he said.⏎“It was, C.B.,” the assistant yelled back. “It was fantastic! Everything went

6. #6 peak

   like chewing tobacco or peyote. Basically, it’s like a temporary, flavored exercise machine for your mouth. So: who would come up with this idea, and why?⏎As with most everything in our contemporary culture, we have to start

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   which can result in the shrinking of the hair follicles. This would result in the inability of the hair follicle to produce hair efficiently and gradually called hair loss, receding hairline and

2. #2 peak

   code of Chivalry, scientific, agricultural and artistic advancements all happened during this time.⏎The Code of Chivalry started in the court of Charlemagne 742-814. Charlemagne not only brought order to

3. #3 peak

   who met in Vietnam on 22-26 November 2010 and who called on the leaders of the world to stop talking and take action on climate change.⏎They were brought together by the British Council Climate Generation Project

4. #4 peak

   organized in Dallas – now Baylor University Medical Center.⏎1919-College of Arts and Sciences organized.⏎1919-College of Fine Arts organized, which consisted of offerings in music and in expression.⏎1921-Ter

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.