end-of-text marker at document breaks

What this neuron does

This neuron reacts to the hidden marker the model uses to show that one document has ended and another begins. It is mostly silent otherwise. Turning it up did not produce a clear, consistent change in what the model wrote.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   , 2012<|endoftext|>Some weather conditions are simply not fun to ride in. As cyclists, windy days

2. #2 peak

   0240.<|endoftext|>By 2003, plenty of data suggested that pesticide drift was harming

3. #3 peak

   ,0<|endoftext|>Guidelines for Restoring Cultural Landscapes⏎Identifying, retaining and preserving

4. #4 peak

   rounded to the nearest integer.<|endoftext|>Christine Duncan, MD⏎Sickle cell disease (SCD) affects as

5. #5 peak

   go<|endoftext|>A running scroll of past classes I have offered……..⏎DEFINITION: The

6. #6 peak

   718<|endoftext|>Women who have kids later on in life may live longer, according to the findings

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   position of formal authority. Alternatively then, if someone without a position of formal leadership is attempting to dominate the conversation, other team members may be less likely to acquiesce.⏎The above hypotheses were tested by Tost, G

2. #2 peak

   is, in the United States.⏎The national Constitution enumerates the powers which may be exercised by the national government, and reserves all other powers “to the States respectively, or to the people.” Because of this dual or double character of our system

3. #3 peak

   1x1, 2x2, 3x3, skill games) and 5x5 play, trying not<|endoftext|>Botanical Name: Asclepias exaltata⏎Plant Family: Milkweed family (Asclepi

4. #4 peak

   transferred to Punjab;⏎iv) demand relating to halting the diversion of Punjab's river water.⏎There was a growing frustration as the Centre was not ready to acquiesce to their political demands. This provided a route to the dharma yud

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.