word fragments before a name, 'ma' bias

What this neuron does

This neuron fires on the opening pieces of words split across tokens, often names or nouns, such as 'bul' in bulge or 'Sel' in Selma. Turned up strongly, the model began writing 'Ma Ma Ma', so it seems to push toward the sound 'ma'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Japanese scifi movie...Scientists have spotted stellar fossils in the center of the Milky Way, globular clusters orbiting in the central bulge which seem to have come from somewhere else. Like all fossils these are vital

2. #2 peak

   Hungarian king Kalman, Jews were permitted to live only in cathedral towns and on bishops estates. In 1241 the Mongols (also known as Tartars) invaded Hungary, wreaking havoc and destruction. Jewish merchants made a major

3. #3 peak

   content was digitised by double rekeying. All rights reserved.⏎The Plague of 1348—The Origin of the Charterhouse—Sir Thomas More there—Cromwell's Commissioners—Prior Houghton—The Depart

4. #4 peak

   lle, o méle, lo méle, u mméla “honey”⏎lo latte, o latte, lə lattə “milk”⏎ru cane “dog”⏎ru peʃʃu “singular fish”⏎

5. #5 peak

   case studies, demographics<|endoftext|>Tom Houck is a lifelong U.S. civil rights activist. In 1965, the white high school student traveled to Selma, Alabama, to participate in the march there, led by the Rev.

6. #6 peak

   May morning to view the medows gay,⏎I met a pretty dairy-maid all in the new mown hay.⏎* 4 *⏎As I was

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   which at the time of the Three States (Samguk 三國) was occupying the South-Western part of the Korean peninsula 3. The state of Paekche, because of the continuous pression exerted upon it by K

2. #2 peak

   , “being Buddha nature and non-being Buddha nature.” I like the use of “being” in this reference. In the first sentence when referencing all tathagatas, he is putting forth the meaning of “non-being Buddha nature”. In

3. #3 peak

   an cheese and roast in the oven for a crispy and flavorful side dish.⏎- Broccoli and mushroom omelette: Saute broccoli florets and sliced mushrooms and fold them into a fluffy egg omelette for a filling and nutritious breakfast.

4. #4 peak

   Nature Beyond Conditions and a commentary by Rev. David Xi-Ken Astor, Sensei⏎BUDDHA NATURE BEYOND CONDITIONS⏎“All tathagatas are without Buddha nature, but at the same time, previously they have fully

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.