unclear: mid-word subword pieces

What this neuron does

This neuron fires on a random-looking piece of a longer word, like the 'stein' in a surname or the 'gone' in 'bygone'. When it was turned up, the model's writing drifted toward plain everyday sentences with no clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   link between blood-vessel health and Alzheimer’s, but this study is “the first one that shows that treating mild cognitive impairment can have results,” says Anton Porsteinsson, MD, director of the Memory Disorders Clinic at the University of Rochester School

2. #2 peak

   apses, they are merged with the past and become a part of history.⏎Hence, history, in this sense, is the knowledge of the bygone incidents, events, conditions and circumstances of the people in the past. Biographies

3. #3 peak

   the feel of a bygone era. Time has effectively stood still along these winding country roads, in the small

4. #4 peak

   parts of the lymphatic system.|⏎|Germ Cell Tumor||GTC. A neoplasm derived from germ cells., normally presenting inside the gonads (ovary and testis).|⏎|Blastoma||More common in

5. #5 peak

   998).⏎The South Africa Education system, which is grounded on the country’s Constitution, views learners as citizens who can secure a new democracy (Joubert, 2009). Learners’ voices should therefore be heard as

6. #6 peak

   enteritis. A bacteria called clostridia was isolated as the organism responsible.⏎Necrotizing enteritis is associated with poor hygiene and an inadequate diet, and it was

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   2:15|⏎|Last Modified:||11 May 2011 04:

2. #2 peak

   the largest family is the Eulophidae with nearly 4,500 included species followed closely by the Encyrtidae and Pteromalidae. The phylogenetic relationships between the

3. #3 peak

   “yarrow” is an Anglo-Saxon word that means “to prepare” because it was

4. #4 peak

   decrease in pressure, thus a net downward force on the paper.<|endoftext|>On May 28, 1828, began the official life of Kaspar Hauser, a young man who appeared mysteriously in the streets of Nure

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.