unclear: document ends and answer colons

What this neuron does

This neuron is hard to pin down. It fires most strongly at the invisible marker that separates one web page from the next, and it switches off hardest on the colon in 'Answer:'. Turning it up made the model ramble and repeat phrases, which does not show a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   code<|endoftext|>Jet engines, or gas turbines, suck in air at the front with a fan

2. #2 peak

   wrong<|endoftext|>External Web sites⏎Britannica Web sites⏎Articles from Britannica encyc

3. #3 peak

   groups<|endoftext|>What happens when you mix vinegar and baking powder?⏎When baking soda is mixed with

4. #4 peak

   officers<|endoftext|>World Science Day for Peace and Development 2019⏎Open Science,

5. #5 peak

   discarding of<|endoftext|>from The American Heritage® Dictionary of the English Language, 4th Edition⏎

6. #6 peak

   9<|endoftext|>Virtual Kid Quest Guide for an Outdoor Art Quest⏎In celebration of Earth Day,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   70%.⏎Answer: B. Humidity levels should be kept below 60 percent, ideally between

2. #2 peak

   are parallel, perpendicular or neither?⏎Parallel lines are the lines that never intersect and perpendicular lines are the lines that intersect at 90 degrees.⏎Answer: Lines with the same slope are parallel and if the slope of one line is the

3. #3 peak

   done.⏎Answer: True. There are hundreds of thousands of dust mites in our homes, from

4. #4 peak

   i.e., "I don't want to see it again").⏎In #2 "saw" is past tense and neutral about the present. (see The<|endoftext|>In the field of meta-ethics, scholars have identified key problems in the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.