end of document marker token

What this neuron does

This neuron lights up on the invisible end-of-text marker that separates one web page from the next. When it was turned up, the model's text came out rambling and repetitive, with no clear link to the neuron's trigger.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   third World Cup turned out to be the last in the pre-World War II era. The world had to wait 12 years before the next tournament.<|endoftext|>An important class of non-Newtonian fluids are those composed of two or more

2. #2 peak

   in close proximity to the⏎Venus. Note that the incised lines on the bird-form piece⏎are very much⏎like those on the Venus figure.<|endoftext|>Think Eat Save⏎Here’s some food for thought: Are you aware that a

3. #3 peak

   and three arctic fox.⏎A visit to the Arctic Ring of Life is more than a fun hike. It opens our eyes to the life of the Inuit<|endoftext|>

4. #4 peak

   eating a variety of nutrient-packed foods every day. Just be sure to stay within your calorie needs. For more information, check out www.mypyramid.gov.<|endoftext|>Nicaragua’s stunning beaches are more than tourist attractions

5. #5 peak

   patient, however, it can almost completely restore vision. Consultation with an ophthalmologist can help determine whether your pet might be a good candidate for surgery.<|endoftext|>Major General Sterling “Pap” Price had

6. #6 peak

   the world in unexpected ways, our day to day lives intertwined with the rest of nature.⏎The post was originally posted on the Natural History Museum of Utah blog.<|endoftext|>Although often used interchangeably, the words "fate" and "destiny

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   zieh Hosseini Araghi, BSc, MPH, of the University of Birmingham, and colleagues concluded.⏎Disclosure: The researchers report no relevant financial disclosures.<|endoftext|>You are here⏎Edward Elgar (1857-1

2. #2 peak

   5|⏎|ISBN: ||9781498738552 (DRM-PDF)|⏎|Read Aloud: ||not allowed|<|endoftext|>Under technical guidance and collaboration with the

3. #3 peak

   to say that there is no evidence that cell phones increase your chance of getting a brain tumor. Further studies will surely be conducted in the coming years but at this point, you’re safe to use all the free night and weekend minutes that you want

4. #4 peak

   6|⏎|ISBN: ||9781771882903 (DRM-PDF)|⏎|Read Aloud: ||not allowed|<|endoftext|>Nanoscale polymer capsules could one day be used to deliver chemotherapy

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.