unclear: 'all', 'little' and 'small' in emphasis
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires weakly on words like 'all', 'little' and 'small' in phrases that emphasise or play down an amount, such as 'Strangest of all' or 'every little change'. The pattern is faint and inconsistent. Turning it down made the text collapse into repeated 'and, or' lists.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and the telescope) can see. Those objects are getting farther away all the time because the universe is expanding, and moreover the expansion is accelerating. Strangest of all, the luminous matter of the galaxies—everything we see shining in the
-
a significant contribution of common sequence variants to the phenotypic variability of common disease4,5⏎. Taken together, these observations have led to the evolution of the Common Disease / Rare Variant
-
беспартийная система⏎5) a right of voting e) гражданин государства⏎6) district court f) гражданские и уголовные дела⏎7) a resident of the state g) правительство⏎8
-
keeping yourself in a position of power by making the people under you disagree with each other so that they are unable to join together and remove you from your position A small minority have continued to govern by a policy of divide and conquer.⏎
-
when he was a kid. All you have to do is find a piece of paper and use your imagination to draw
-
you wish to move up, you’ll need to prove again and again that you know how to navigate technology. Sometimes, having that little bit of extra knowledge can really make a difference in your salary and lifestyle down the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if, for, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or, or,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
18th century, to Peter I?⏎Professor Andrzej NOWAK: One could draw three lines along which this phenomenon develops. The first, probably the oldest, is connected with the hope of converting the Orthodox Moscow,
-
8 note) who remarks: — "Um dies (i.e. Varro's description of the extent of Roma quadrata) mit dem unten erörterten Pomerium und der Auffassung des Dionys. I 8
-
ifism among its electorate, let alone industrial backwardness. It was in essence a warfare state, organized around the successful prosecution of war, albeit of a very specific kind (a new kind of machine-based conflict).⏎The background to Britain’s entry
-
no longer match the original. Another case is where we need to authenticate some data, i.e. produce a kind of integrity check that only a party with a given private key could produce. (In this case, the general solution is to combine
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1415 excites
- L18:767 excites
- L18:2189 excites
- L11:870 excites
- L4:1743 weakly suppresses
- L13:976 weakly suppresses
- L16:507 weakly suppresses
- L17:3009 weakly suppresses
- L18:247 weakly excites
- L14:315 weakly excites
- L3:247 weakly excites
- L18:238 weakly suppresses
- L6:199 weakly excites
- L8:14 weakly excites
- L17:543 weakly excites
- L1:289 weakly suppresses
- L17:416 weakly suppresses
- L18:560 weakly excites
- L18:1952 weakly suppresses
- L3:997 weakly excites
- L1:1460 weakly excites
- L8:16 weakly suppresses
- L18:135 weakly excites
- L16:981 weakly suppresses
Feeds later layers
- L20:2016 excites
- L22:576 excites
- L25:2331 excites
- L20:811 suppresses
- L27:358 suppresses
- L22:397 excites
- L20:79 excites
- L21:1071 excites
- L27:905 excites
- L22:368 suppresses
- L26:765 excites
- L27:1064 excites
- L27:130 excites
- L25:127 suppresses
- L20:1009 suppresses
- L22:158 excites
- L27:291 suppresses
- L20:2831 excites
- L24:1505 excites
- L26:236 suppresses
- L22:632 suppresses
- L20:3003 excites
- L27:191 weakly suppresses
- L26:22 weakly excites the 'res' fragment inside words
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 's
- 的
- ’s
- 的是
- 的就是
- 的距离
- 的地
- なもの
- 的日
- 的传统
Suppresses
- 、
- ,
- 或者
- ITOR
- aurus
- ảy
- це
- ences
- antry
- entials