the digit 1 in years
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the digit 1 when it is part of a year such as 2011 or 2021, and also to the 1 in codes like COVID-19. When it was turned up, the model's replies did not show a clear shared theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to the U.S. census. Without adequate paid maternity leave, mothers are frequently forced to quit stable jobs and disrupt career plans. Add to that $611 in average monthly childcare costs (U.S. Department of Labor), which is more
-
Journal of Biogeography, 48(7), 1594-1605 https://doi.org/10.1111/jbi.14097⏎
-
family studies⏎Langley, Elizabeth Dale, "Parenting Styles and Perceptions Across Christian Denominations" (2011). ETD Collection for Pace University. AAI346737
-
prices and marginal speculation in food have done the same.⏎2011 also saw the highest average oil prices since 2008, at $
-
||Water (%)||1.57% (1,014 km2)|⏎|-||2011 estimate||2,229,641 (143rd
-
thrusts those alternate plans into our faces, which can make some people who already have self-esteem issues feel insecure about their social interactions.⏎In 2011 at the Annual Convention of the American Psychological Association, Larry D. Rosen, who
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately, and I have been thinking about lately. So I think that I have been thinking about lately. I think that I have been thinking about lately. I think that I have been thinking about lately. I think
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
10 @ 8:30 pm In General | 4 Comments⏎Across the globe, young people are paying attention to what is happening at the COP16 climate negotiations in Cancun, Mexico. They are the “climate generation”
-
some circumstances if you are carrying or showing symptoms of coronavirus (COVID-19). Face coverings should not be used as a replacement for social distancing or
-
will have come up with a workable topic for their essay and learned to focus on points in their lives, rather than the entirety of it.<|endoftext|>COVID-19 Vaccine Enters Final Test Phase⏎The COVID-19 pandemic seemingly has
-
have been given — a weevil species with their own name in the backyard.<|endoftext|>February 16, 2021⏎COVID-19 and the unexpected switch to remote learning have negatively impacted college students’ academic performance
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L4:1721 suppresses the gap before a decade or century
- L18:1361 weakly excites
- L9:657 weakly excites
- L3:1035 weakly suppresses
- L25:1965 weakly suppresses the digit 1 in age ranges
- L21:2912 weakly suppresses
- L16:1220 weakly suppresses
- L7:1001 weakly suppresses
- L8:457 weakly suppresses year digits in copyright and dates
- L23:286 weakly suppresses
- L10:2418 weakly suppresses
- L5:1090 weakly suppresses
- L18:824 weakly excites
- L26:1465 weakly suppresses
- L6:1683 weakly excites
- L19:2153 weakly suppresses
- L15:442 weakly suppresses
- L20:2620 weakly suppresses
- L5:2150 weakly suppresses
- L9:275 weakly suppresses
- L14:2447 weakly excites
- L27:2519 weakly suppresses
- L3:88 weakly suppresses
- L21:1365 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- lias
- 查询
- 霄
- 吾
- Ra
- ession
- 者
- throughout
- itta
- iro
Suppresses
- lemn
- pregn
- SplitOptions
- shouldBe
- ')['
- .nz
- ertain
- 在这种
- 多い
- .Lines