end of document token

What this neuron does

This neuron fires on the invisible marker that separates one web page from the next in the training text. When it was turned up, the model's output did not show a clear change in theme. It also goes quiet or negative on numbers inside lists or counting sequences.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   countless texts in the canon of English literature. The subject occupies a prominent position in a diverse array of genres and forms, among which is that of the modern...<|endoftext|>The Hundred Years' War began in the reign of Edward

2. #2 peak

   .⏎You can also purchase the Almanac Monthly at the iTunes Store !<|endoftext|>Learning in dissolving boundaries⏎Talking about changes inherent in the move to what the

3. #3 peak

   Virginia.⏎To summarize, then, the Civil War Center is committed to the following:⏎WHY KENNESAW STATE UNIVERSITY IS AN⏎<|endoftext|>[Last Updated: April 2nd, 2015]⏎Con

4. #4 peak

   the globe.⏎The definitions of ‘buddy’ and ‘bro’ in the OED have recently been revised. We explore their history and increase in popularity.<|endoftext|>Native Plants for the Mid-Atlantic⏎On this page⏎- What Are Native

5. #5 peak

   . Please see the bottom of the page for more information or visit our Terms and Conditions.⏎Thanks for your feedback.⏎37 of 42 found this helpful<|endoftext|>Television was hardly a reliable broadcast medium

6. #6 peak

   of all bourgeois states, France and Britain prominent among them.⏎What made you want to look up "Constantinople Agreement"? Please share what surprised you most...<|endoftext|>Your healthcare provider will ask about your medical and family history and your overall health.

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   center activities!⏎- Engaging morning work!⏎- Homework variety!⏎- Individual pages for facts 1-12 (-1, -2, -3, etc. up to -12)⏎- Mixed facts practice pages⏎-

2. #2 peak

   index i and decrementing the value of i by 1.⏎If you run this program, it will print the below output:⏎5 4 3 2 1⏎We need to use the range function to iterate over the array using

3. #3 peak

   5, 27, 28, 31, 32, 33, 34, 35, 36, 37, 39, 49, 51

4. #4 peak

   a matrix⏎Find nth maximum⏎Matlab Basics II - Create a vector with a repeated entry⏎Create sequnce 1 4 9 16 25.........⏎Basics: Divide integers to get integer outputs in all

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.