punctuation right after 'of' or 'with'

What this neuron does

This neuron fires most strongly on a comma or colon placed right after a word like 'of' or 'with', where the phrase is not finished yet. Its strongest peaks are very clear. Turning it up made the model hesitate and repeat itself, with 'wait, no' and similar fillers.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   the early stages of their recovery to develop shows about the seduction of, addiction to, and recovery from drugs and alcohol.⏎We analyzed anonymous surveys completed by

2. #2 peak

   '] fruit = ['raspberry', 'pomegranite', 'bananana', 'grape', 'loganberry'] print "You are an" , random.choice (verb) , random.choice (fruit)⏎Any Tutorial Videos?

3. #3 peak

   - About this particular statue of the Infant KingHow did this image come to be chosen as the symbol of, and the object of, devotion at the Shrine of Christ the King? A.

4. #4 peak

   how this works⏎Tip: insert a question mark by pressing your spacebar.⏎Definition of: ALLY⏎- (n.) See Alley, a marble or taw.⏎

5. #5 peak

   and keep pace with, and even to influence the scope and outcome of negotiations that serve the best interests of

6. #6 peak

   on it generation after generation. So we the Islam of today learners should make important to look back over and make research topic selected on this issue and gain knowledge of, respected and Prized the contribution Islamic Civilization by early Muslim scholars⏎The first Muslim

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   or can be readily restored to shoot, automatically more than one shot, without manual reloading, by a single function of the trigger.” 26 U.S.C. § 5845(b). The machine gun was first widely used during

2. #2 peak

   documents for those who are going to build it for you and also for legal purposes. We will cover all these things in details. Some of the topics include but not limited to:⏎- How to Plan and Draw/design Your Dream Home⏎- Understanding

3. #3 peak

   Five miles south of here is Egan Canyon, where one of the oldest gold mines in Nevada was located. Indians

4. #4 peak

   for up 0 for down).⏎Unfortunately, at this point, the up or down state could not be accurately predicted, thus, it wouldnt be useful for much of anything. To make the switch come to rest in a predetermined up or down

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.