end-of-text token and answer-stating phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is weak and mixed. Its strongest hits are the invisible end-of-document marker right after a finished article, and it dips on phrases like 'the answer is'. Turning it up or down gave text that varied a lot, with no clear shared topic.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Anger can surface at any time. When you feel pain, you may want to lash out at the people around you.<|endoftext|>In Northern Ireland the Irish language has the power to enrage and enthral.
-
of all bourgeois states, France and Britain prominent among them.⏎What made you want to look up "Constantinople Agreement"? Please share what surprised you most...<|endoftext|>Your healthcare provider will ask about your medical and family history and your overall health.
-
vf = vi + at⏎= 56.3m/s + (-9.81m/s2)(4.52s)⏎vf = 12.0 m/s⏎This value is still positive, but smaller.
-
Find out more information here⏎A study has revealed one in five children in Herefordshire are not fully immunised against measles. Click here for more information.<|endoftext|>What is the Raspberry Pi?⏎The Raspberry Pi is a miniature computer that is ideal
-
least 12 missions to carry cargo to and from the International Space Station as part of the Commercial Resupply Services (CRS) contract for NASA.⏎For<|endoftext|>|1st person||me me||nos us|⏎|2nd person||
-
, it’d be impossible to definitely pinpoint which aircraft faired better in the Luftwaffe. When flown against Allied bomber raids, neither was a welcome sight.<|endoftext|>Cancer Prevention and Early Detection⏎Choosing a healthy lifestyle can
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I think the answer is... and the answer is... and the answer is... and the answer is... and the answer is... and the answer is... and the answer is... and the answer is... and the answer is... and the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
. By present, crowded standards, almost all outdoor sports require an exorbitant amount<|endoftext|>Guess Who? Identity theft?⏎“Does your person have blue eyes?” “Does your person have massive eyebrows?” “Is your person wearing a hat?” “
-
not have 15m customers or measure their Twitter output in terabytes, so is big data truly going to have an impact on them? The short answer is yes – a significant impact – and one that is already attracting the interest of new
-
203 deaths in 2019. “How do those rates compare to the death rates from the coronavirus vaccine?” Carlson asks. The answer is, there’s really no comparison.<|endoftext|>Technology can help fight cheating that is itself
-
happens that Easter falls on the Sunday during Passover. Presents are not exchanged on Passover.⏎Question: Is Passover the first Jewish holiday the Jews celebrated?⏎Answer: You are correct -- Passover was the first holiday that the Israelites celebrated
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1263 strongly suppresses
- L12:1478 suppresses
- L12:2824 excites
- L12:3005 suppresses
- L13:1366 suppresses
- L11:2977 suppresses
- L13:1489 excites
- L12:1170 excites
- L13:2485 suppresses
- L13:89 suppresses
- L14:3008 excites
- L12:298 suppresses
- L13:1049 excites
- L14:1290 excites
- L11:1653 suppresses
- L14:2212 excites
- L11:770 excites
- L14:1802 weakly excites
- L11:324 weakly suppresses
- L7:2313 weakly excites "to" after "proved" or "proves"
- L12:2501 weakly suppresses
- L12:2574 weakly suppresses
- L13:1169 weakly excites
- L14:370 weakly suppresses
Feeds later layers
- L16:2837 suppresses
- L16:814 excites
- L16:2204 suppresses
- L16:1564 suppresses
- L16:2912 suppresses
- L17:867 suppresses unclear: punctuation before an explanation
- L16:2870 suppresses
- L17:1164 excites
- L16:1193 suppresses
- L19:2288 suppresses
- L16:1499 suppresses
- L17:820 suppresses
- L18:1544 suppresses
- L19:1597 suppresses
- L20:796 weakly suppresses
- L16:2370 weakly suppresses
- L16:1008 weakly excites
- L17:2207 weakly excites
- L19:2740 weakly suppresses
- L18:2739 weakly suppresses
- L16:2506 weakly excites
- L16:349 weakly suppresses
- L16:1067 weakly suppresses
- L16:347 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 就够了
- йте
- multipart
- 体重
- 就行了
- 算了
- dea
- %m
- (Tag
- cia
Suppresses
- Brussels
- Kremlin
- ガン
- aber
- istle
- rule
- 一律
- ativ
- สวน
- answer