'out of' in ratios and rankings
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' in phrases like 'ranked 73 out of 187' or 'nine out of 10'. These are the strongest hits in the set. Turning it up made the model produce number-heavy, list-like text, which fits the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
2013 – a notable improvement from 0.557 in 1980. The index ranks Sri Lanka 73 out of 187 countries and places the country in the high human development category.
-
2015.⏎In early 2015, I reported on the 10 largest point source greenhouse gas emitters in Missouri. Nine out of 10 were coal burning electricity generating stations, and together Missouri’s big three
-
the presence of blisters. That is why some would call the condition as fever blisters. These can appear anywhere in the body, although almost 9 out of 10 cases will mostly affect the lips and the insides of the mouth
-
Bird Hunting and Conservation Stamps — were created in 1934 as federal licenses for hunting migratory waterfowl. Nearly 98 cents out of every dollar collected from the sale of Duck Stamps (and Duck Stamp merchandise)
-
experience of paying bribes or using a contact to get a job done in public office.⏎In 2012 India has ranked 94th out of 176 countries in Transparency International's Corruption Perceptions Index, tied with
-
Mainland. ...⏎Not exactly what<|endoftext|>War and Peace in the Nuclear Age; Bigger Bang for the Buck, A; Your Defense (Part 1 of 2)⏎Part of War and Peace in the Nuclear Age.⏎Introduction by Secretary of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I will do the thing I do (and do it) in the future. So, I will do it (the future) the thing (and do) it (the future) (and do) it (again) and do it
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
been possible, if the industry had been unable to act as a cohesive whole. How this intra-industry cooperation was achieved is not yet fully clear. Be that as it may, the negotiations were successful and led to the world’s first habitat by
-
manger.” 13 And suddenly there was with the angel a multitude of the heavenly host praising God and saying,⏎14 “Glory to God in the highest,⏎and on earth peace among those with whom he is pleased!”⏎1
-
is recorded in several Roman mosaics.⏎The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept"
-
planet has never been seen with human eyes or by a telescope. Be that as it may, we realize it exists because of its gravitational draw on its host
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2925 suppresses
- L13:2226 suppresses
- L11:2547 suppresses
- L13:2368 suppresses
- L13:2420 excites
- L12:1238 suppresses the word 'entry' in reference text
- L12:2493 excites
- L14:2509 excites
- L8:1066 excites the total after "N of" in fractions
- L12:2344 weakly excites
- L12:2211 weakly excites
- L10:2016 weakly suppresses
- L3:2846 weakly excites
- L7:1476 weakly excites
- L12:1484 weakly excites
- L11:2083 weakly suppresses
- L6:620 weakly excites "and" in lists of three or more
- L8:1483 weakly suppresses
- L1:602 weakly excites
- L13:2171 weakly suppresses
- L13:106 weakly suppresses
- L1:2361 weakly suppresses
- L11:2411 weakly suppresses
- L10:2836 weakly excites
Feeds later layers
- L18:1680 excites
- L18:3048 excites
- L17:2984 excites blank before a number in prevalence claims
- L17:2677 weakly excites
- L16:2578 weakly excites
- L16:1921 weakly excites
- L17:1932 weakly excites
- L16:2380 weakly excites
- L20:516 weakly excites
- L17:2322 weakly excites
- L17:1899 weakly excites
- L17:159 weakly excites
- L16:2536 weakly excites
- L19:173 weakly excites
- L17:1506 weakly excites
- L21:1430 weakly excites
- L18:3018 weakly suppresses
- L17:890 weakly excites
- L24:2295 weakly suppresses
- L16:1128 weakly excites
- L18:1517 weakly suppresses
- L20:2561 weakly excites
- L23:1712 weakly excites
- L16:1811 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- _TOTAL
- 三位
- Total
- (total
- TOTAL
- 三位一体
- 挂在
- 几位
- трех
- total
Suppresses
- inic
- ivia
- atsu
- atcher
- patibility
- razil
- ښ
- bao
- anse
- safety