the word 'about'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'about' in many senses: 'that's about all', 'about to try', 'about 99%', 'about as sexy as'. Turning it up made the model's text drift toward news-like and general wording, though the steered outputs are not very clearly on one theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and francophone countries.⏎- Colonial rule⏎ASJC Scopus subject areas⏎- Economics and Econometrics⏎- Organizational Behavior and Human Resource Management<|endoftext|>- About ASTI⏎- Pay and Conditions⏎- ASTI Membership⏎- Operation of
-
you can attach a label to it that says this home meets the HUD Code. Obviously there are several layers of bureaucracy involved in all of this, but that’s about all there is to it.⏎There are fines for failures to comply with the Code
-
the family from then on.⏎That’s about all I’d say in a first go-round; go into other details (like
-
transmission of electrical signals and also deliver energy to neurons and remove neuronal waste products. While appearing to be a little more interesting than originally thought, glia still seemed about as sexy as wire insulation, food delivery and
-
the Museum of Connecticut Glass hosted "It's About Connecticut Glass," an exchange between local historical societies, representatives from Connecticut glass works,
-
Overall, these tests have excellent detection rates (~99%) with very low false-positive rates (~0.2%). In other words, these tests are about 99.0% sensitive and 99.8% specific.⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: some people can be very successful, but not to the same level to which others are successful. That is, there are no absolages for the same kind of success. So I have to be more creative, to see more possibilities to make
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Bethel and Dan, whose golden bull-calf statues they declared idolatrous.⏎In reaction<|endoftext|>Like Father, Unlike Son⏎The Battle of Tours in 732 was a turning point in the wars against the Umayyad Cal
-
, January 2003, December 2006⏎Part I: The Umayyad Caliphate (661 – 750 CE)⏎5 Tibet on the Eve of the Arrival of the First Muslim
-
much more!⏎Discover the world of gorillas and other primates their remarkable intelligence and social behavior⏎66 pages; ISBN 9780756668082⏎, or download in⏎More Ju
-
that usually is followed by an implication that could be generalized for a broader extrapolated definition. This particular one is derived from the good old Spring and Autumn period (772BC to 403BC) and the Warring States period
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1442 strongly suppresses unclear: word fragments and digits inside numbers
- L0:2319 excites
- L18:205 suppresses
- L4:1049 excites
- L2:2028 suppresses
- L18:569 excites
- L18:173 excites
- L16:112 excites
- L18:139 suppresses
- L4:1393 suppresses
- L11:981 excites
- L16:84 excites
- L16:135 suppresses
- L18:1380 weakly excites
- L16:503 weakly excites
- L16:673 weakly excites
- L16:75 weakly suppresses
- L16:374 weakly excites
- L17:350 weakly excites
- L16:78 weakly suppresses
- L2:43 weakly suppresses
- L3:50 weakly excites
- L10:559 weakly suppresses
- L14:643 weakly excites
Feeds later layers
- L20:1793 suppresses
- L20:558 suppresses
- L21:2906 excites
- L20:2115 excites
- L22:607 excites
- L27:3013 weakly suppresses capital L opening an acronym
- L20:121 weakly excites
- L22:2379 weakly excites
- L21:2341 weakly excites
- L20:342 weakly excites
- L21:442 weakly suppresses
- L25:2499 weakly excites
- L22:512 weakly excites
- L21:1582 weakly suppresses
- L26:1051 weakly excites
- L23:2163 weakly excites
- L23:1408 weakly excites
- L20:1310 weakly excites
- L20:2371 weakly excites
- L26:1012 weakly excites
- L22:2526 weakly excites
- L23:2739 weakly suppresses
- L22:2254 weakly excites
- L26:1456 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ificação
- ыв
- oque
- igel
- 름
- 위
- éo
- 的最佳
- feito
- anje
Suppresses
- inflate
- oses
- underline
- Tes
- сол
- Sibling
- truncate
- osed
- osing
- 庸