the digit 6 in years 19xx
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the middle digit of years in the 1900s, especially the 6 in 1961, 1963 or 1969. Turning it up did not make the text talk about years, and the link to the negative side is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
would be a combination of the then-Egyptian anthem and "Homat elDiyar" When Syria seceded from the union in 1961, the⏎anthem was completely restored.⏎Translation of Syrian National Anthem:⏎
-
, pondering the influence of the various strands of Irish nationalism on the modern state.⏎Finally, the book reviews the conflict in Northern Ireland from the 1960s all the way to the fall of
-
17-1918), the Second World War (1941-45), and events such as the Cuban Missile Crisis (1963).⏎During the Seminole Wars, the Spanish American War,<|endoftext|>Could
-
and passed away after 6 years.⏎Dolly wasn’t the first vertebrate to be cloned. That honour belongs to a carp, cloned in 1963.⏎The first cloned mouse,
-
in the war. This represents about 22% of the men of fighting age, a terrible loss in a small community. Returning servicemen formed a Kincardine O’Neil branch of the Royal British legion. This link will,
-
that space travel was beyond the scope of human capacity, yet astonishingly, technological advances allowed a human to walk on the surface of the moon in 1969 – a feat unimaginable to humans living a mere century before. Since that
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: through the use of through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through through
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
. But when you consider that stress has been linked to a host of other disorders, including depression, heart attacks, hypertension and increased susceptibility to infection, it’s easy to understand how one herb can have an all-encompassing, tonic effect.⏎
-
Canada Metals (Pacific) Limited, Delta, BC, Canada (Martyr Brand), www.canmet.com<|endoftext|>5 interesting facts about the Singapore River clean-up⏎Published on Jul
-
DOES SUN EXPOSURE CAUSE CANCER?⏎One of the reasons people don’t get as much sun as they
-
. In fact, the sequence has 30 conjectured members. Similarly, our estimate predicts 2.5 members starting from 86. It is easy to check that the sequence doesn’t contain any more numbers below 200
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1473 excites "can" after a noun in a clause
- L4:173 suppresses
- L17:953 excites the word 'can' after a subject
- L20:2487 suppresses
- L3:978 suppresses
- L10:384 excites
- L18:1491 suppresses
- L19:2701 suppresses
- L19:243 weakly excites
- L19:1865 weakly suppresses
- L19:1138 weakly excites
- L21:443 weakly suppresses
- L4:904 weakly excites
- L16:1153 weakly suppresses
- L20:2375 weakly excites
- L4:777 weakly suppresses
- L17:670 weakly excites
- L21:381 weakly suppresses zeros inside long number codes
- L1:1926 weakly excites
- L5:2772 weakly excites
- L2:2386 weakly suppresses
- L2:1259 weakly suppresses
- L10:2291 weakly suppresses
- L16:2702 weakly suppresses
Feeds later layers
- L24:883 weakly suppresses
- L23:756 weakly suppresses
- L27:219 weakly excites
- L26:2729 weakly excites
- L23:833 weakly suppresses
- L23:2441 weakly excites
- L23:1687 weakly suppresses
- L23:2735 weakly suppresses
- L25:523 weakly suppresses
- L24:2435 weakly excites
- L24:2654 weakly excites
- L26:3027 weakly suppresses
- L23:1061 weakly excites
- L24:921 weakly suppresses
- L26:1915 weakly excites
- L23:2161 weakly suppresses
- L25:2479 weakly suppresses
- L26:1832 weakly suppresses
- L27:2054 weakly excites
- L27:686 weakly excites
- L24:2846 weakly excites
- L26:1136 weakly suppresses
- L24:1605 weakly suppresses
- L27:1802 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- zy
- law
- icles
- ncia
- Tet
- -collar
- -law
- Braz
- law
- nc
Suppresses
- 通过
- through
- -through
- _through
- 以
- 见
- 看你
- Through
- through
- pector