digits inside population and census numbers
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the last digits of large comma-formatted numbers, especially population counts and census figures like '1,526,006'. The negative side picks up odd numeric or table-style values. Turning it up produced rambling text that did not mention numbers in any clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
As of the 2010 Census, the city had a population of 1,526,006, growing to 1,547,607 in 2
-
in 2002, the 26th largest US city. Its estimated 2002 population was 560,415, but its metropolitan area (including Boulder and Greeley) exceeded 2,
-
Virginia's population is estimated at 1,844,128, showing a decline from the 1.853 million recorded at the
-
state of Utah. As of the 2010 census, the population was 231,236, making it Utah's fourth-most populous county. Its county seat and largest city
-
sites in the body.⏎MET proto-oncogene (GeneID: 4233) has a total length of 125,982 bp, and it is located in the 7q31 locus of chromosome
-
⏎1787, and named in honor of Joseph Addison, the celebrated English writer.⏎Capital, Middlebury. Population, 26,549.⏎is the chief town. This county is bounded on the north by Chitt
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: It's a new year, so it's a good time to measure our progress. So, what it means to do it means the same as the number of people in the room. We can measure it. It's a good time to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the environment. Organic fabrics, unlike industrial cotton does not release any toxic fumes and are environment friendly.<|endoftext|>Results for 'rail'⏎- Length: 4 characters⏎- Syllables: 1⏎Results for word: rail⏎-
-
choice. You’d be amazed how coherent even a very young child’s story is. When he was 3, my son dictated a three page/ 3 line story with a complete story arc about a bubble to me. He drew the pictures
-
64⏎BJU Science Grade 2 Activity Manual Teacher's Edition (Third Edition)BJU Press / 2010 / Other$31.6
-
2002 population was 560,415, but its metropolitan area (including Boulder and Greeley) exceeded 2,417,908 or more than half the state's population in 19
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:2358 excites
- L10:651 weakly suppresses
- L10:1178 weakly excites
- L8:7 weakly excites
- L8:978 weakly excites
- L10:1269 weakly suppresses
- L10:50 weakly excites
- L10:736 weakly excites
- L0:493 weakly excites
- L8:2503 weakly excites
- L4:2563 weakly suppresses
- L10:1913 weakly excites
- L2:1004 weakly excites
- L10:695 weakly excites
- L10:773 weakly suppresses
- L7:3017 weakly suppresses
- L2:2822 weakly suppresses
- L5:323 weakly excites
- L6:1125 weakly suppresses
- L9:1422 weakly suppresses
- L7:853 weakly excites
- L9:1169 weakly suppresses
- L8:3 weakly excites
- L3:856 weakly suppresses
Feeds later layers
- L12:2434 suppresses
- L13:1301 suppresses
- L14:929 suppresses
- L12:947 suppresses
- L14:1809 suppresses
- L13:2314 excites
- L13:2265 excites
- L13:1530 suppresses
- L12:455 suppresses
- L12:1194 excites
- L12:1272 excites
- L17:2811 suppresses
- L12:1935 suppresses
- L13:2333 excites
- L12:2679 excites
- L19:2011 suppresses
- L15:2607 weakly suppresses
- L14:2257 weakly suppresses
- L18:1571 weakly suppresses
- L21:2419 weakly suppresses
- L14:536 weakly excites
- L13:791 weakly suppresses
- L12:1407 weakly excites
- L14:253 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ADATA
- Clintons
- |i
- icense
- _batches
- ürn
- TOT
- 더라
- INGTON
- oti
Suppresses
- single
- ้าย
- 祚
- емся
- single
- imentary
- (single
- 限度
- alone
- starter