document boundary token

What this neuron does

This neuron fires most on the invisible 'end of text' marker that separates one web page or document from the next. It also fires weakly on a few words that start a new idea. Turned up, the model's output became repetitive and unfocused.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   are checked to verify they meet the required specifications.⏎<|endoftext|>RASPBERRY Pi - LEARNING HOW TO MAKE YOUR ROBOT WORK⏎

2. #2 peak

   firstname.lastname@example.org.<|endoftext|>The Musical Representation⏎How human musical experience emerges from the audition of organized tones is

3. #3 peak

   Hospitals use it to access patient records and share test results. Governments use it for elections, services and disaster alerts. The global financial system—bank transfers,

4. #4 peak

   ycetica<|endoftext|>Adding Fractions Level 3⏎The 5-step planIn Adding Fractions

5. #5 peak

   to give updated information once medical findings become available.<|endoftext|>History of Women Cheesemakers⏎Throughout human history, women were the primary

6. #6 peak

   on the book "Dots and Dashes: Adventures at the Dawn of the Wireless Age" is at http://vubooks.com<|endoftext|>Child health nursing is designed to help the students to develop and understand the concept of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   rih B. Approach to family assessment and intervention. Natl Med J India 2017;30:27

2. #2 peak

   the Aurora Borealis. It contained standard scientific instruments.⏎But things - almost - went horribly wrong.⏎Routine

3. #3 peak

   the discs that cushion the bones of the spine (the vertebrae). To treat degenerative disc disease, doctors usually begin with conservative (nonsurgical

4. #4 peak

   Canada, by the British North America Act (July 1, 1867). The province of Canada is divided into Ontario and Quebec. The United States of America

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.