unclear: pieces inside numbers and blanks

What this neuron does

This neuron is weak and hard to read. It fires on odd spots such as a single digit inside a number, a blank line, or a comma in a big number. Nothing about it is clearly about one topic, and turning it up did not bring out a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   128.0/17 SUBNET3 : 10101100.00010001.0yyyyyyy.yyyyyyyy => 172.17.0.0

2. #2 peak

   were 1, 2 and 134. All these vehicles were fitted with ballast ploughs.⏎N 1

3. #3 peak

   1, 1/4 turn clockwise and then back 2_______.⏎5.1/4 turn clockwise, forward 3, 3

4. #4 peak

   and “motto” theme, but does not stay there long. The tumultuous Allegro begins in D minor, a key as far as possible from A-flat (Elgar wrote to his friend August Jaeger that he had “thrown over

5. #5 peak

   48x2048 pixels,⏎be sure to set camera to this or lower⏎- Handheld GPS,⏎preferably one with 100’ or better accuracy that allows⏎marking locations and naming them⏎Accuracy is important

6. #6 peak

   ||Water (%)||1.57% (1,014 km2)|⏎|-||2011 estimate||2,22

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   plumage with a black back.⏎- ‘Neophytes at duck identification often confuse a bufflehead with a male hooded merganser when the latter's crest is raised showing a large patch of white feathers.’⏎- ‘These

2. #2 peak

   a familiar spirit.⏎How do we reconcile these apparently conflicting statements? We do so by recognizing that the latter statement is the figure of speech “metonymy of the subject.” The actual

3. #3 peak

   (1) military operations, (2) weapons technology, (3) diplomatic activities, (4) intelligence activities, and (5) cryptology. The latter two areas might be considered to be special parts of the first three areas. That

4. #4 peak

   , Guatemala, Florida, and France between 1789 and 1809.2 Much remains to be known about the St. [End Page 37] Dominguan diaspora in France and in the circum-Car

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.