'of' after a count or quantity
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows a number or a quantity word, as in 'four of her five', 'eight of them' or 'how many of each'. Turning it up produced clumsy phrases like 'a few of the few', and turning it down produced loops of the word 'numbers'. The pattern in the text is clear even though the steered writing is odd.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
family. If you don’t do well, it’s not just your failure it’s the extended family as well.⏎Marrying an unstable husband and having four of her five in five years would stress anyone, but Flora still wanted her children
-
ius' genealogy began in 1996 and is the fifth of its kind. But this time, female descendants will be included, and their names
-
on the U.S. Team in the 1936 Olympic Games held in Berlin, Germany. They won 14 medals — eight of them gold: a quarter of the 56 medals won by the entire U
-
m) wide. Among all of the 37 shipwrecks discovered at Yenikapi, there
-
Answers⏎- What was the first thing that God created?⏎- Which day did God create plants?⏎- What was the boat Noah built called?⏎- How many of each type of animal did Noah have on the ark?⏎- What is the symbol
-
.⏎A design (noun) is nothing more than a pattern of events arranged by intent or design (verb).⏎An event is an occurrence or a happening. Each of the six letters in the word
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the number of prime numbers between 1 and 249999999999999999999999999999999999
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
point to one or more transactions that show where you got them from, and say how many Bitcoins you are transferring where. It's like saying "I got Bitcoins at transaction X. I'm sending 20 coins to address B."⏎- The
-
The two rims are separated by a distance of only a couple of kilometers. To the west is the bowl-shaped crater Schmidt, and farther to the north are Manners<|endoftext|>In
-
BBEP) said things could have been much worse had the state agencies not responded so quickly.⏎Just north of North Beach, along Highway 181, is a small island. Not one that locals or
-
approx<|endoftext|>“Snow White,” the beloved, first, full-length animated feature film, created by the Walt Disney Studios, is celebrating its 75th anniversary this year with a major exhibit at the Walt Disney Family Museum in San Francisco.⏎Called
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1744 suppresses 'the' in mid-sentence noun phrases
- L18:1477 suppresses
- L19:455 suppresses
- L18:1238 excites
- L17:851 excites
- L18:1547 suppresses
- L19:2948 suppresses
- L18:1957 suppresses
- L19:1539 excites
- L18:2855 suppresses
- L19:2842 suppresses
- L19:1732 suppresses
- L17:1706 excites
- L18:834 excites
- L18:1691 suppresses
- L18:1144 excites
- L19:1379 excites
- L19:2115 excites
- L6:426 suppresses
- L6:1655 excites "a" or "an" after "such" or launch verbs
- L19:1658 suppresses
- L18:2513 suppresses
- L19:2782 excites
- L18:1556 excites
Feeds later layers
- L22:360 excites
- L21:696 suppresses
- L21:274 excites
- L22:825 excites 'for' before a span of time
- L21:757 suppresses
- L23:24 excites
- L24:823 excites
- L21:216 excites
- L25:377 suppresses
- L22:303 weakly excites
- L24:488 weakly suppresses
- L23:1305 weakly excites
- L27:449 weakly suppresses
- L21:444 weakly suppresses
- L26:678 weakly suppresses
- L22:4 weakly excites
- L25:45 weakly suppresses
- L26:714 weakly suppresses
- L21:894 weakly suppresses unclear: end of a phrase before a continuation
- L25:374 weakly suppresses
- L24:419 weakly suppresses
- L25:1009 weakly suppresses
- L22:694 weakly suppresses
- L21:843 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 每个
- 每人
- 每一个
- 几个
- 每位
- 一台
- 每
- 一部
- 一棵
- 一头
Suppresses
- onz
- quil
- ogeneous
- ume
- combinations
- ustin
- finishes
- plates
- �
- pedest