end-of-document separator token

What this neuron does

The neuron lights up on the invisible marker the model uses to show where one web document ends and another begins. When it was turned up, the written text drifted into unrelated rambling, with no clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   0240.<|endoftext|>By 2003, plenty of data suggested that pesticide drift was harming

2. #2 peak

   , 2012<|endoftext|>Some weather conditions are simply not fun to ride in. As cyclists, windy days

3. #3 peak

   old<|endoftext|>Immune cells in the brain have surprising influence on sexual behavior⏎Relatively uncommon

4. #4 peak

   etto is already<|endoftext|>The North Carolina Gold Rush took place decades prior to the 1849

5. #5 peak

   :<|endoftext|>Copyright © University of Cambridge. All rights reserved.⏎'Aim High' printed from

6. #6 peak

   :<|endoftext|>The hamstring muscles – the biceps femoris, semitendinosus,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   asiveness of viral campaigns in social network sites: Persuasive intent as the underlying mechanism. Journal of Marketing, 18(1), 39-53. http://dx.doi.org/10.108

2. #2 peak

   rin Froese (2008). Organic Virtue: Reading Mencius with Rousseau. Asian Philosophy 18 (1):83 – 104.⏎Tao

3. #3 peak

   environments.⏎Source: Health Behavior and Policy Review, Volume 8, Number 4, July 2021, pp. 281-293(13)⏎Publisher: Paris Scholar Publishing Ltd.<|endoftext|>March Is

4. #4 peak

   ⏎James Behuniak Jr (2011). Naturalizing Mencius. Philosophy East and West 61 (3):492-515.⏎David E. Soles (1999). The Nature

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.