'of' after a percentage or share
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows an amount or share, such as '31 percent of', 'Fewer than 1% of' or '60 percent of'. It is less active on words like 'with' or 'to' that end a phrase. Turning it up gave replies with no clear link to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
race were 0.89% of the population.⏎There were 46 households out of which 28.3% had children under the age of 18 living with them, 65.2% were married<|endoftext|>
-
the hard, cortical bone that makes up the outer portion of these bones.⏎Like OFD, adamantinoma is very rare. Fewer than 1% of all cancerous tumors that begin in the bone are adamantinomas.⏎These slow
-
33 percent) than were nonveterans (19 percent).⏎Among Gulf War-era II veterans in 2009, 31 percent of veterans aged 18 to 24 years were enrolled in school. As
-
nea include older age, male sex, and higher BMI. In a new study of 1448 people living with Parkinson's, 45% of participants experienced sleep apnea. In addition to the general risk factors, for people
-
erry, India. You may make a digital copy or printout of this text for your personal, non-commercial use under the condition that you copy this document without modifications and in its entirety, including this copyright notice.⏎
-
15 the number of mobile phone subscribers in North Korea reached 3.24 million, (about 13%) and that about 60 percent of the population in Pyongyang, the capital, between 20 and 50
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about the problem of the way of using the software and the way of using the software and the way of using the software and the way of using the software and the way of using the software and the way of using the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
6⏎“Those things, which ye have both learned, and received, and heard, and seen in me, do: and the God of peace will be with you” — Philippians 4:9⏎The theory or norm of
-
voice of a giant.⏎When the people looked over the barriers to see the black, smoking pits where the lightning bolts had struck, they realized what could have happened to them if they had advanced up the slopes. All the people, awed at
-
(GNBDK)⏎Never do to anyone else anything that you would not want someone to do to you. “Do not drink so much wine that you get drunk, and do
-
arrival of Jesus. This is why it is so significant that the angels described Jesus’ birth as “peace on earth.”⏎9 And an angel of the Lord appeared to them, and the glory of the Lord shone around them, and they were
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1653 suppresses
- L9:1909 excites
- L12:850 excites
- L11:2207 suppresses "of" after a noun in trademark and title phrases
- L12:2680 suppresses
- L12:2215 excites 'of' after 'one' or 'some' (partitives)
- L9:2871 suppresses
- L11:2497 suppresses
- L12:2347 suppresses
- L12:2535 suppresses
- L10:272 suppresses
- L12:2875 suppresses
- L8:1003 suppresses "the" or "of" before a noun phrase
- L11:1174 suppresses
- L11:3015 suppresses
- L12:1040 excites
- L3:2989 excites
- L10:1121 weakly excites 'to' or verb after 'what' or 'whether'
- L6:1222 weakly excites
- L11:1861 weakly suppresses
- L6:487 weakly suppresses
- L12:1404 weakly excites
- L6:1735 weakly excites
- L3:2185 weakly suppresses
Feeds later layers
- L14:2861 excites 'of' after a percentage
- L14:672 suppresses
- L18:2598 weakly excites
- L18:224 weakly suppresses
- L14:1191 weakly excites
- L18:516 weakly suppresses
- L17:224 weakly suppresses
- L16:229 weakly suppresses
- L16:928 weakly excites
- L20:2161 weakly excites
- L17:2792 weakly excites
- L22:231 weakly excites
- L14:1317 weakly excites
- L17:1652 weakly excites
- L17:225 weakly suppresses
- L18:92 weakly suppresses
- L15:1369 weakly suppresses
- L20:900 weakly suppresses end-of-text right after cut-off text
- L20:1942 weakly excites
- L15:1771 weakly excites
- L17:2034 weakly suppresses
- L17:593 weakly excites
- L14:968 weakly suppresses
- L15:37 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ctions
- dge
- oren
- already
- d
- SEE
- BCE
- [list
- neau
- atab
Suppresses
- ously
- izzy
- ToSend
- uss
- _except
- identally
- ivant
- reuseIdentifier
- razil
- 颠