token before a statistic or number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the symbol or blank just before a number in research and measurement text, like the '<' in 'p < .001' or the '$' before '2' in a list of bills. When turned up, the model often produced long strings of dots, so the steering effect is not very informative.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
had resolved (mean difference –0.71 pg/mL, 95% CI, –1.09 to –0.34; P < .001)
-
national sample. Lifetime use rates for American Indian students were higher than those of the national sample for all substance measures except tranquilizers and amphetamines (all P <.05). The greatest discrepancy was observed for 8th grade students:
-
($0.50), and the dollar ($1). Paper money or banknotes are printed by the Federal Reserve. Today, they come in $1, $2, $5, $10, $20, $50
-
attended one of 2 DST performances. Participants demonstrated increased knowledge on 5 fact-based questions (mean improvement range, 19%- 35%; p < .001 for all), and favorable changes on
-
10 items addressing perceptions regarding substance use risk (paired t test range, 3.9-9.4; p < .001 for all). Through iterative thematic analysis we developed an alliter
-
are not IC rated fixtures should be installed in such a manner that they are at least 1/2 inch away from any rafters and no closer than 1/2 inch from ceiling insulation. When selecting bulbs for either type of fixture
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: In the world, many things are true, and many things are false, and many things are true in some cases and false in other cases, and also, in the world, the number of false and true in total to be equal in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
son of the Tordesillas who was put to death by the Comuneros at Seville. He studied in Spain and Italy, and became secretary to Vespasiano Gonzaga, a brother of the Duke of Mantua, who was
-
Since the beginning of July 2021, VAUDE’s organic canteen has been completely vegetarian or vegan. Chef Rainer Seibold has always sourced his ingredients regionally, organically and fairly – and he
-
is also prevalent in sections of Central America, northern Australia and North America, specifically in sections of Mexico and the state of Florida in the United States.⏎The Köppen Climate Classification subtype for this climate is "Aw". (Tropical Sav
-
burg-Western Pomerania, tensions in the CDU-CSU union have intensified. Bavarian State Premier Horst Seehofer has blamed Merkel's refugee policy for the AfD's success.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:1638 strongly excites
- L21:1104 excites
- L22:342 suppresses
- L21:1735 excites
- L20:509 excites
- L22:2003 suppresses
- L16:1466 suppresses
- L12:1098 excites
- L19:248 excites
- L19:2062 excites
- L20:805 suppresses
- L22:1177 excites
- L14:1152 excites
- L21:2187 weakly excites
- L9:2915 weakly suppresses
- L12:2491 weakly suppresses
- L18:569 weakly excites
- L20:1682 weakly suppresses
- L19:1033 weakly excites
- L21:2169 weakly excites
- L8:2821 weakly suppresses
- L18:3051 weakly suppresses
- L20:387 weakly suppresses
- L9:18 weakly excites text boundary after a document break
Feeds later layers
- L27:1182 strongly excites
- L25:725 strongly excites
- L26:887 strongly excites
- L25:656 excites
- L27:703 excites
- L26:1825 excites the first dot of an ellipsis
- L25:1135 excites
- L24:2879 excites
- L26:481 suppresses
- L26:316 weakly excites
- L25:2924 weakly excites
- L25:1826 weakly excites
- L26:11 weakly suppresses
- L24:462 weakly excites
- L26:167 weakly excites
- L24:2816 weakly suppresses
- L26:373 weakly suppresses
- L25:412 weakly excites
- L25:229 weakly excites
- L24:1960 weakly excites
- L24:1194 weakly excites
- L25:1987 weakly excites
- L24:556 weakly excites
- L24:1532 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- .
- (.
- (.
- `.
- ','.
- /.
- [.
- ,.
- -.
- ".
Suppresses
- uten
- Establishment
- igung
- .Assertions
- FAILURE
- ixo
- bru
- .Execute
- 马来
- すぎ