the digit 1 starting a year
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the digit 1 at the start of a year, like the 1 in 1896, 1848 or 1874. Turning it up made the writing wander into unrelated topics, so the effect on the text is not clear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
contrast to chemical pesticides – have no adverse effects on animals or humans.<|endoftext|>F. Scott Fitzgerald⏎Francis Scott Key Fitzgerald (September 24, 1896 – December 21,1940) was an
-
, early 20th century.⏎© Science Museum / Science & Society Picture Library⏎This wall telephone uses the chalk receiver invented by Thomas Alva Edison (1847-1931) in 1878.
-
location.⏎Like much of California, Sacramento’s railroad shops grew quickly.⏎Just 14 years after gold was discovered at Sutter’s Mill in 1848 and only a dozen years after the state was admitted to the Union
-
pertinent and weighty, it cannot be too extended.⏎Eccl. Law. The name of a kind of papal rescript.<|endoftext|>Edward Hopper (1882-1967).⏎His enigmatic depictions of America
-
comma and a death. Numerous authors of that era wrote gruesome tales about being buried alive. Among them were Edgar Allen Poe who published The Premature Burial (1844), The Cask of Amontillado (184
-
of many who thought of themselves as “progressives.” It appeared in western Europe and then spread to the United States, becoming especially evident in the Progressive Era (1890 to 1
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The right to right now being right now, so right now being right now, right now being right now, right now being right now, right now being right now, right now being right now, right now being right now, right now
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
record we have of the military conflict is the myth of the wars between the supernatural guardians of the different peoples. Such a myth is that of the wars between the Hellenic gods and the Titans and giants, and the celestial usurpation by
-
sephone. No one, god nor mortal, has the courage to tell her what happened. Finally, through information gleaned by the pre-Olympian goddess Hecate, Dem<|endoftext|>English Grammar and Social Class⏎With grammar, as with
-
after a Greek original from the 4th century BC. ( Public Domain )⏎The famous Hymn then begins with the reciting of Zeus’ agreement with Hades in regards to Persephone. To be sure, his being an absentee
-
throughout theworld." (LXXXI.3)The moon will either be outright destroyed or permanently hidden, for we are told that it will be eaten by Hati Managarm, and the sun will be spattered by its blood.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:1086 excites
- L21:3013 suppresses
- L24:909 weakly excites
- L12:1007 weakly excites
- L18:344 weakly suppresses
- L13:383 weakly excites
- L20:1902 weakly excites
- L23:2895 weakly suppresses
- L23:2441 weakly excites
- L22:1694 weakly excites
- L15:1096 weakly excites
- L22:1203 weakly suppresses
- L14:95 weakly excites
- L21:1667 weakly excites
- L17:241 weakly excites
- L1:1441 weakly suppresses
- L4:2091 weakly excites
- L2:1317 weakly excites
- L3:244 weakly suppresses
- L0:952 weakly suppresses
- L17:28 weakly excites
- L0:2177 weakly excites
- L21:593 weakly excites
- L3:1552 weakly excites
Feeds later layers
- L26:976 strongly excites the '1' starting a century
- L27:763 excites
- L27:785 suppresses
- L26:580 suppresses
- L27:496 weakly suppresses
- L26:898 weakly suppresses
- L27:1389 weakly excites
- L26:977 weakly excites
- L26:1823 weakly suppresses
- L27:1213 weakly excites
- L27:1500 weakly suppresses
- L27:678 weakly suppresses
- L26:739 weakly suppresses
- L27:2715 weakly suppresses
- L27:1842 weakly suppresses
- L26:658 weakly suppresses
- L26:2180 weakly suppresses
- L26:882 weakly excites
- L27:1646 weakly suppresses
- L27:1968 weakly excites
- L26:1484 weakly suppresses
- L26:2666 weakly suppresses
- L26:2008 weakly excites
- L26:1023 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- iales
- 八
- iotic
- OLS
- 小店
- iton
- 8
- ⼋
- urable
- 八个
Suppresses
- 让他们
- Extra
- ろ
- ery
- _extra
- Body
- mẽ
- prolifer
- .View
- retty