end-of-text token after document breaks

What this neuron does

This neuron fires most strongly on the hidden 'end of document' marker that separates one web page from the next. When it was turned up, the text drifted into odd, unrelated topics with no clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   959,<|endoftext|>Everyone's heard about an apple a day. As one of the most popular fruits

2. #2 peak

   criteria.<|endoftext|>The haunting image of the fallen soldier, aged just 18, is one

3. #3 peak

   :<|endoftext|>Copyright © University of Cambridge. All rights reserved.⏎'Aim High' printed from

4. #4 peak

   :<|endoftext|>The hamstring muscles – the biceps femoris, semitendinosus,

5. #5 peak

   the support leg; <|endoftext|>MAHAD SATYAGRAHA AND BABASAHEB AMBEDK

6. #6 peak

   , and other vehicles.<|endoftext|>Most people remember the adage that having a hot breakfast will set the tone for

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   behavior. Here's a class called CarParts that declares a static inner class called Wheel. If we consider the real-world, we can find many objects

2. #2 peak

   re toothed tiger. This adrenaline rush causes the memory to be imprinted into the amygdala, which is part of the limbic system. The amygdala holds the emotional significance of the event, including the intensity of emotion. The

3. #3 peak

   oding – you’ve got to manage the energy you bring into a room and have a plan. With a plan, your brain is moving out of the reactive amygdala

4. #4 peak

   counsel is grounds for automatic reversal of the conviction. Other mistakes are judged by the Harmless Error Rule. The Confrontation Clause of the Sixth Amendment gives the defense the right to cross-examine witnesses who testify about lineups, Showups,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.