unclear: end-of-text markers and word fragments

What this neuron does

This neuron fires most strongly on the hidden marker that signals the end of one document, right where an unrelated text would begin. It is hard to pin down beyond that. When it was turned up, the model's replies drifted into unrelated topics, with no clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Siberian ginseng, improves stamina and enhances immune function, as do reishi mushrooms — another adaptogenic remedy. Ashwagandha, an Indian<|endoftext|>Moral FriendSeries teasers are where you try to complete the sequence of a

2. #2 peak

   data. Further, the cloud and artificial intelligence have a symbiotic relationship. The cloud handles the fundamental source of information that augments artificial intelligence networks, and artificial<|endoftext|>If I were to think of an emblematic phrase, in arts education, it

3. #3 peak

   4, 1957, Sputnik, the Soviet satellite that was the first to orbit Earth, shocked Americans and delighted the Soviets. A month<|endoftext|>O’Connell, Caitlin and Donna M. Jackson. The Elephant Scientist.

4. #4 peak

   , and encouraged trade and industry, dispatching a seaborne trading expedition to Punt, a land on the Somali coast of Africa, and exploiting the copper<|endoftext|>Industrial design is a process of design applied to products and industrial goods that are to

5. #5 peak

   Prev Med Rep⏎Authors: Altman EA, Lee KL, Hecht CA, Hampton KE, Moreno G

6. #6 peak

   queen Violant sought support for her grandchildren from her brother, King Peter III of Aragon, who agreed to protect and guard them in the kingdom of Aragon<|endoftext|>ALR provided recommendations that helped inform the national Childhood Obesity Task Force action plan,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   blackberries, pears, raspberries, strawberries, whole grain breads and bran cere

2. #2 peak

   gardenia.⏎Insecticides kill off the whitefly’s natural predators. These predators include

3. #3 peak

   side effects”⏎While the changes are only a few percent, with more than 40

4. #4 peak

   Porcelain⏎Process – Raw Porcelain is rolled to create the tile, each letter is

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.