the '9' in years 19xx
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the digit 9 in years that start with 19, such as the 9 in 1914 or 1943. Turning it down made the model repeat the word 'divide' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
galvanized by the failure of the international community to prosecute Turkish officials involved in the genocide of approximately one million Armenians between 1914 and 1918.⏎No doubt Lemkin would have been
-
XV1 condemned "the genocide of the Jews" during the Jewish Holocaust when six to eight million Jews were killed by a European named Adolf Hitler in the 1930s. However
-
<|endoftext|>The Battle of the Kasserine Pass was a battle that took place during the Tunisia Campaign of World War II in February of 1943. It was a series of battles fought around Kasserine Pass,
-
laws and regulations imposed by the Nazis and their collaborators to facilitate the annihilation of the Jews.⏎Lemkin’s campaign was crowned with success in December 1948, when the United Nations adopted the Genocide Convention. It defined genocide
-
Brittany Hutchinson, assistant curator at the Chicago History Museum. “They did this in 1918.”⏎The Article Describes The Pandemic of 1918
-
Raphael Lemkin, who coined that term seventy years ago this autumn, would have been appalled by such abuse of his life’s work.⏎During the 1930s, Lemkin, a Polish Jewish attorney and expert on the development
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: divide the divide, divide the divide, divide the divide, divide the divide... divide the divide divide the divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide divide
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
- Undesirable things.⏎- Confrontational - Arguments / Dispute.⏎- Dissent - Strong disagreement or dissatisfaction.⏎- Fissures - Split or deep crack.⏎- Condemnation - Act of saying that something is unacceptable.⏎-
-
inequalities that exist offline. So it’s no surprise that the majority of unconnected people are women and girls.⏎Connecting these women and girls is critical to closing the digital divide, and essential for boosting economic growth. Internet access allows women to gain a
-
and within different regions and different countries when it comes to accessing science, technology and innovation (STI) and enjoying their benefits. To address these disparities and close the existing STI gaps, Open Science is an important step in the right direction.⏎
-
/⏎They also say…. ‘ Students with special learning needs may offer the most concrete evidence of the benefits of tablets in the classroom. Advocates, desperate to bridge the educational gaps in children with learning issues
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2383 weakly suppresses
- L14:2612 weakly suppresses
- L17:1838 weakly suppresses
- L19:2904 weakly excites
- L17:1989 weakly suppresses
- L12:2834 weakly excites
- L5:504 weakly excites
- L14:2037 weakly excites
- L22:2304 weakly suppresses
- L6:2920 weakly excites
- L18:1138 weakly excites
- L22:2975 weakly suppresses
- L12:2852 weakly excites
- L15:1337 weakly suppresses
- L20:690 weakly excites
- L7:2883 weakly excites
- L11:2176 weakly excites
- L20:570 weakly excites
- L7:538 weakly excites
- L2:1920 weakly suppresses
- L12:2402 weakly suppresses
- L4:1382 weakly suppresses
- L5:1173 weakly suppresses
- L22:1197 weakly excites
Feeds later layers
- L24:1232 suppresses
- L26:2421 suppresses
- L27:1311 suppresses
- L27:2099 suppresses
- L24:1807 suppresses
- L24:2434 suppresses
- L26:770 weakly suppresses
- L24:1329 weakly suppresses
- L25:1452 weakly excites
- L25:1884 weakly excites
- L26:724 weakly suppresses
- L27:296 weakly suppresses
- L24:1372 weakly suppresses
- L26:1517 weakly suppresses
- L25:2453 weakly suppresses
- L24:2697 weakly suppresses
- L26:1100 weakly suppresses
- L27:874 weakly suppresses
- L24:621 weakly suppresses
- L24:1822 weakly suppresses
- L26:2375 weakly excites
- L24:1349 weakly suppresses
- L26:1468 weakly excites
- L27:2577 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- uada
- edly
- pwd
- ildo
- đỡ
- ila
- .badlogic
- мом
- lint
- iant
Suppresses
- divide
- divides
- dividing
- division
- divide
- Divide
- divisions
- divided
- splits
- 分