end-of-text token between documents

What this neuron does

This neuron fires on the hidden marker that separates one document from the next, much like its neighbours. Turning it up made the model repeat single words such as 'football', 'music' and 'cloudy', which is not clearly related to the trigger.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   /definition/acanthosis nigricans>.<|endoftext|>Dronacharya was the teacher of both the Kauravas and Pand

2. #2 peak

   ycetica<|endoftext|>Adding Fractions Level 3⏎The 5-step planIn Adding Fractions

3. #3 peak

   -Pecos.<|endoftext|>top of page⏎Patterns of tree-liana interactions: distribution and host preference of

4. #4 peak

   to like.<|endoftext|>The late Dominica-born writer Jean Rhys, best known for her novel “

5. #5 peak

   edible nut.<|endoftext|>Canal Park is a little tourist area around the canal that leads into the Saint

6. #6 peak

   criteria.<|endoftext|>The haunting image of the fallen soldier, aged just 18, is one

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   realize tradition is a living and operative reality. Thinking about the experiences of the French in the midst of the Vichy regime and the Second World War, Simone Weil wrote:⏎“In the atmosphere of anguish, confusion, solitude, uprooted

2. #2 peak

   agonists (Allbuterol/Salbutamol, Proventil, Ventolin) and theophylline (Theodur, QTSR) work by opening up the bronchial tubes

3. #3 peak

   here ensures a smooth and easy understanding of all the concepts. Understand the concepts behind every Unit and score well in the board exams.⏎6. How does the play The Duchess of Malfi end? Do you suggest any alternative ending?⏎Ans:

4. #4 peak

   right of free speech does not exist.⏎Iocasta: That's a slave's life—to be forbidden to speak one's mind.⏎(Euripides, The Phoenician Women; author's translation)⏎Writers in exile often face the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.