end-of-text token after a document

What this neuron does

This neuron reacts to the hidden marker the training data uses to separate one web page from the next, which shows up right where a document ends. Its strongest negative reactions are on a closing quotation mark followed by a comma. Steering had no clear visible effect.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   their . place. So, the students, teachers and other professionals finally had to resume their studies and jobs in government institutions like schools, colleges, courts etc.<|endoftext|>I hope you are all well and that you enjoyed some of your weekend in the

2. #2 peak

   Hydrogen<|endoftext|>Educational Technology and Mobile Learning: 8 Excellent Augmented Reality Apps for iPad

3. #3 peak

   management, risk management and time management skills.⏎- Software development in Java using various web-development technologies.⏎Figure 1: Traceability User Interface⏎Back to top<|endoftext|>William Gilly has seen a Kraken. The mythical squid beast with⏎ship

4. #4 peak

   which can be physical or concepts, etc⏎Definitions of Rail:⏎Cambridge Dictionaries |⏎New Zealand |⏎Similar Words (using 'rail' as word stem):<|endoftext|>First Flag Flown⏎In 1960, when CDC moved from

5. #5 peak

   Saturday<|endoftext|>15.1: The Science Fair (5 minutes)⏎The purpose of this

6. #6 peak

   Rocky Mountains. OSC will continue to better understand wolverine behavior and advocate for increased local and national coordination.<|endoftext|>Regional Broadband Global Area Network (RBGAN)⏎Definition - What does Regional Broad

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ,” according to Currier.⏎Read the full article, Which States Have the Most Economic

2. #2 peak

   ,” Dawson said. “Alltech’s distinct set of technologies can help in maintaining healthy

3. #3 peak

   ,” we get the subject form (An Luan), and, by following genitive

4. #4 peak

   ,” 05/31/2002, WGBH Media

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.