unclear: end of document token

What this neuron does

The neuron's strongest reactions are around the marker that separates one web page from the next in the training text, which the model sees as a hard stop. Its large reactions are negative, and it does nothing clear when turned up.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   . It will contain an appropriate error⏎message for the user.⏎Upon success, this is the file handle returned by⏎``urllib2.urlopen``. Per urllib2, it has an ``info()`` method⏎containing things like headers

2. #2 peak

   Increases Cardiovascular Risks⏎Led by James L. Vacek, M.D., a team of researchers at the University of Kansas Medical Center undertook a<|endoftext|>The Tenderlett lancet was made for single use in a lancing device.

3. #3 peak

   the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.⏎Contact your local office<|endoftext|>It’s PrAACtically Martin Luther King Jr Day⏎Looking for activities and

4. #4 peak

   , or whether it’s heavy metals, or whether it’s nitrogen and phosphorus – will make it to the sea. And that means that probably water quality will<|endoftext|>Harlem riot of 1935⏎The Harlem riot of 1

5. #5 peak

   it encountered the overwhelming gravitational force of the much larger mass. This force wrenched luminous stars from the small galaxy. Over billions of years of evolution, the<|endoftext|>Duplicating Data Elements⏎Using keywords and synonyms is one way to ensure that

6. #6 peak

   the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.⏎Contact your local office<|endoftext|>The point in the Moon's orbit where it lies diametrically⏎opposite

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   'S', then click at the end of the word and type<|endoftext|>Mallorca’s popular tourist railway, the ‘Orange Express,’ has entered its

2. #2 peak

   and Ragusa.<|endoftext|>Yellow fever is a disease carried by female mosquitoes. The species of mosquito that carry

3. #3 peak

   running. Slow to<|endoftext|>South-eastern Australia is one of the most bushfire-prone areas in the

4. #4 peak

   comment.<|endoftext|>100 Chemistry Questions and Answers 8211; Basic Chemistrynbsp

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.