unclear: word fragments and digits inside numbers

What this neuron does

The snippets don't share a clear pattern. The strongest hits sit on odd fragments inside words or numbers, such as the piece "Sevent" in "Seventeen" or "them" in "thematically". It is strongly negative on the digit "7" inside years like 1765. Turning it up or down gave unrelated text, so the neuron's job is hard to pin down.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   highlighted for years as the ninth planet in the solar system.⏎However, in 20

2. #2 peak

   000 and were so interconnected by marriage that they represented a giant family rather than a new polyglot community. The community was governed by The Council of Seventeen in Amsterdam, who governed the far-reaching empire of the Dutch East India Company

3. #3 peak

   shape them using a jigsaw. 3. Drill holes in the stringers and attach

4. #4 peak

   cholesterol from animal products we take in when eating. Even more interesting is the fact that at

5. #5 peak

   changing fundamentally, but also the way people learn. Learning trends such as mobile learning, micro

6. #6 peak

   heat. Fish oils are notorious for their self-heating properties. Mineral oils like white spirit, mineral turpentine or lubricating oil are not prone to self-heating and will not cause spontaneous ignition.⏎It

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   th century, the term was extended from the talker to the conversation of such persons. Th<|endoftext|>Radicalism and the Common People: Britain c.1789-1880 - 30 credits (HS17

2. #2 peak

   7, 28, 31, 32, 33, 34, 35, 36, 37, 39, 49, 51, 6

3. #3 peak

   became legal tender in much of the country and many used hemp to pay their taxes.⏎The cultivation and spread of hemp in the United States continued and in 1765 George Washington made reference to growing hemp in

4. #4 peak

   is predicated on changing human behavior; the purview of Psychologists (reviewed in , see also [2,3,4,5,6,7]).⏎So-called “environmental problems” are really problems of human behavior, caused

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.