end of document boundary tokens

What this neuron does

This neuron mostly lights up on the marker that signals the end of one document and the start of an unrelated one, so it seems to notice where a new piece of text begins. Turning it up made the model's writing wander into unrelated topics, with no clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   code<|endoftext|>Jet engines, or gas turbines, suck in air at the front with a fan

2. #2 peak

   are found, there is no way<|endoftext|>We won’t stop until we’ve eradicated HIV/AIDS⏎The Drug Development Process

3. #3 peak

   can we say we believe in it? It is up to me and you.”⏎Adafruit publishes a wide range of writing and video content, including interviews and reporting on the maker market and the wider technology world. Our standards page is intended as a

4. #4 peak

   groups<|endoftext|>What happens when you mix vinegar and baking powder?⏎When baking soda is mixed with

5. #5 peak

   | Volume 25, Issue 1⏎That was the end of the campaigning in 1776. Washington went

6. #6 peak

   the Students from Student table whose marks is more than Average of all marks.⏎(Select Avg(M<|endoftext|>Euler's Equation and the Physical Reality. =. a) Euler's Equation

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   % off) $17.25 new (22% off) $21.95 direct from Amazon Amazon page|⏎Setup an account with your affiliations in order to access resources via your University's proxy server⏎Configure custom

2. #2 peak

   conjugate, write the correct conjugate acid or base for the species in the pair.⏎a. H2O, OH-⏎Frequently Asked Questions⏎What scientific concept do you need to know in order to solve this

3. #3 peak

   quality lesson planning resources, fast!⏎Share & remix collections to collaborate.⏎Organize your curriculum with collections. Easy!⏎Have time to be more creative & energetic with your students!⏎In this verb tense review worksheet, students are given sentences and must find

4. #4 peak

   collections to collaborate.⏎Organize your curriculum with collections. Easy!⏎Have time to be more creative & energetic with your students!⏎Students explore the Orange Revolution. In this Orange Revolution lesson, students examine the climate of the Ukrainian protest and investigate the role

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.