end-of-text token mid-document

What this neuron does

This neuron reacts to the hidden 'end of document' marker that the training data uses to join unrelated web pages. It is most active right where one page seems to stop and another starts. Turned up, it made the model write repeated filler, and turned down it made the text drift toward puzzles and quiz-style questions.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   to look up "vocable"? Please share what surprised you most...<|endoftext|>Biggles Sees It Through⏎|Published||Aug-41 - Oxford

2. #2 peak

   arnessed this sequence to overcome a myriad of hurdles. plants use it to sprout branches no one gets covered and each gets maximum amount of sunlight, and as<|endoftext|>Помогите пожаааалуйста, сам не с

3. #3 peak

   413/Healthy Hunger Free Kids Act implementation; (2) assess changes in the proportion of schools with excellent water access and barriers and facilitators to More<|endoftext|>Minnesota is a disclose in the Upper Midwest,

4. #4 peak

   two different numbers cant have the same cube). Therefore, by Definition 1, is one-to-one....⏎View Full Document⏎- Spring '09<|endoftext|>part of speech: noun⏎definition 1: an upright line or pole with

5. #5 peak

   by 5 and 7, then increase⏎count by one.⏎Share your code⏎Show a friend, family member, or teacher what you've done!<|endoftext|>cigarette butts are the most common form of plastic litter

6. #6 peak

   puzzle.⏎Click for Sudoku Puzzles from previous weeks.⏎Click for tips for teaching students to do Sudoku puzzles.⏎Copyright © 2006 Education World<|endoftext|>1.Modeling design and nozzle selection of musical fountain .⏎For the overall design of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   the synergy of every team member.⏎n.大綱, 提要 [ summary or outline of a book, play, etc ]⏎note: 字

2. #2 peak

   tornado one day? Michaud’s prototypes have all proved successful but no investors have expressed an interest as of yet.⏎Dissolving the Dead⏎Traditional burials raise a

3. #3 peak

   :⏎Reaching a wider audience effectively! : Because an instructor can handle a small mob at a time only. When every other student bombards him with questions and raises hand in every micro second, the teacher sits down with head in his hands.⏎

4. #4 peak

   ). It is one of Indonesia's most active volcanoes and lies in one of the world's most densely populated areas. Many people raise crops and livestock in its shadow.⏎Yudhoyono has announced that residents

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.