end-of-text token between documents

What this neuron does

This neuron lights up on the hidden end-of-document marker that separates one web page from an unrelated one. Turning it up made the model's writing drift into odd, repetitive word loops, so the effect on text is hard to read.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   1, on the Mall in front of the National Air and Space Museum. The museum will also be hosting a scholarly conference on Civil War ballooning on June <|endoftext|>Most veteran peanut farmers in the Southeast will remember the devastating spread of tomato spotted wilt

2. #2 peak

   be considered a planet, reigniting discussions.⏎In<|endoftext|>The Carnival season, or “Apokries” in Greek, is slowly coming

3. #3 peak

   applications include improved communications technology, television displays and night-vision devices.⏎Tags: Lene Vestergaard Hau, physicist, spped of light.<|endoftext|>The Real

4. #4 peak

   carried out for the samples with greenschist discontinuities, and found the characteristic of shear creep failure is closely related to the development of the structure surface.<|endoftext|>Japan’s Aerospace Exploration Agency (JAXA) is charting new territory in

5. #5 peak

   on your feet. This can cause plantar fasciitis for the first time, or trigger a new bout once you have already healed.⏎If you know that<|endoftext|>CNN

6. #6 peak

   , u, t)$.⏎<|endoftext|>While many students view summer as a time to forget about school, it remains an

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ’s article by Jeremy Rosen on Rav Lichtenstein is available from http://jeremyrosen.blogspot.co.uk/2015/08/rav-lichtenstein-zl.html⏎Your comment will be posted after it is approved.⏎

2. #2 peak

   needed.⏎1. Children are starving as a result of famine. (is)⏎2. Where there is suffering that can be relieved, it should be relieved. (

3. #3 peak

   against the Indian students. As a result, Subhash Ch<|endoftext|>BröstuligaOld Norse Dictionary - bröstuliga⏎Meaning of Old Norse word "bröstuliga" (or brǫstul

4. #4 peak

   asti||ist, is (greek esti)|⏎|bandha (bind)||bind, bandage|⏎|iccha, isha (to wish)||wish|⏎|jan (produce offspring, born)||generate, genocide|⏎|k

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.