end-of-document marker token

What this neuron does

This neuron reacts to the invisible marker the model uses to mark where one web page or document ends and another begins. Turning it up made the model's writing wander into odd, unfocused directions, but the link to the marker is the clear part.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   caused<|endoftext|>This preview shows pages 1–2. Sign up to view the full content

2. #2 peak

   he advocated for peace with the European Americans⏎Date de dernière mise à jour : 05/07/2021⏎Ajouter un commentaire<|endoftext|>By DANIEL SUDDEATH⏎NEW ALBANY —⏎Judging

3. #3 peak

   asked<|endoftext|>Counties that gained Wal-Mart stores during the 1990s f

4. #4 peak

   994- Drexel University. All rights reserved.⏎The Math Forum is a research and educational enterprise of the Drexel University School of Education.<|endoftext|>Maybe you’ve tried intermittent fasting (IF) to shed a few (pand

5. #5 peak

   5mm or 120 roll film into a developing canister.⏎- Processing the film⏎Step-by-step instructions to develop your film.⏎Leave a Comment<|endoftext|>As human activities drive Earth’s rapidly changing climate, there is an urgent need to

6. #6 peak

   a Chemistry Tutor<|endoftext|>Those who fight for us, also need people to fight for them.⏎The military

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   cardinal numbers. You will need to add the cardinal numbers together and the fractions together. Finally, you need to check whether you can simplify the answer.⏎Step 1 - Addition, but don't forget to simplify⏎Step 2 - Drag the

2. #2 peak

   much more!⏎Discover the world of gorillas and other primates their remarkable intelligence and social behavior⏎66

3. #3 peak

   today is totally different and not close to what used to be American music. The question which many people ask is the vents which led to such intensive change. This essay focuses on American music genre Jazz rap which has engulfed the original culture of America

4. #4 peak

   attle to produce sound. They will also be able to hold their head steady.⏎- Step 7: Hug them at four to five months and they should try to hug

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.