the '1' starting a century
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the digit 1 at the start of a century, like the 1 in '1800s' or '18th century'. When turned up the model drifted into talk about 'four' and 'middle', and when turned down it repeated the digit 8.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
let letter, Reverend Dimmesdale, and burrs to add onto the overall theme of guilt.⏎Nathaniel Hawthorne was a writer in the 1800s, an anti
-
Cudnow. Count and Polish writer.⏎In the historical narrative Soplica’s Memoirs (1839), which takes place in the mid-18th century, Rzewuski created a gallery of types from the Polish
-
Book Society', founded in 1878.⏎Polled Herefords were developed from the horned Hereford breed which was founded in the mid-18th century by the farmers of Hereford County, England. Among the horn
-
the Reformation.⏎John Knox and the Monstrous Regiment of Women | Presbyterian Historical Society.<|endoftext|>The Booth family was an English-American theatrical family of the 19th century. Its most famous and well known members were Edwin Booth, one
-
817 and 1826, whose purpose was to educate and train non-white Christian missionaries. The book focuses upon the evangelical movement of the 19th century, and American attitudes on interracial relationships as demonstrated in the unfavorable,
-
1760 and 1782. This piece is a excellent example of that cross section of Baroque and Classical styles found in the mid-1700s, and bares stylistic similarities to Haydn's own
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ Ⅷ �
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
anticipation of the availability of the more secure and complex WPA2, which became available in 2004 and is a common shorthand for the full IEEE 802.11i (or IEEE 802.1
-
⏎Ink painting originated in China during the Tang dynasty (AD 618-907) and was known in Japan by the eighth century.
-
heart is resting between beats.⏎Along with high cholesterol and being overweight or obese, a high blood pressure diagnosis, also known as hypertension (over 130/80), is a major risk factor for heart disease or stroke. And because
-
a greater optical density than air.⏎Substance Speed of light (m/sec)⏎Vacuum 3 x 108⏎Air 3 x 108⏎Water 2.258 x 108⏎Glass
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1969 strongly suppresses
- L21:1794 strongly suppresses
- L25:2029 strongly excites
- L25:2947 strongly excites the digit 1 starting a year
- L25:2807 excites
- L23:903 suppresses
- L25:2442 suppresses
- L22:83 excites
- L23:2992 excites unclear: first pieces of split words
- L24:1968 excites
- L23:1369 suppresses the '0' in years like 2008
- L22:72 suppresses
- L24:800 suppresses colon in clock times
- L25:2971 excites
- L21:2064 excites
- L24:2840 excites
- L21:563 excites
- L25:1702 excites
- L22:58 suppresses
- L21:1211 excites
- L22:1092 excites
- L23:2964 suppresses
- L18:47 excites
- L23:1166 suppresses
Feeds later layers
- L27:763 strongly suppresses
- L27:785 strongly excites
- L27:1087 suppresses
- L27:1389 suppresses
- L27:1138 weakly suppresses
- L27:893 weakly excites
- L27:1100 weakly suppresses
- L27:572 weakly excites
- L27:2123 weakly suppresses
- L27:602 weakly suppresses
- L27:2182 weakly suppresses
- L27:934 weakly suppresses
- L27:496 weakly excites
- L27:800 weakly excites
- L27:1207 weakly suppresses
- L27:1738 weakly excites
- L27:1904 weakly excites
- L27:2918 weakly suppresses
- L27:391 weakly excites
- L27:1177 weakly excites
- L27:1707 weakly suppresses
- L27:2958 weakly suppresses
- L27:788 weakly suppresses
- L27:1713 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ayah
- entially
- 隱私權
- Player
- HEAD
- crypt
- 裂
- elf
- seguridad
- くれ
Suppresses
- 8
- eight
- 八
- eight
- Eight
- eighty
- 8
- -eight
- 八个
- eighth