'World War II' and the 'II' after 'War'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the "II" in "World War II", and only weakly on related war terms. Turning it up or down did not give a clear shift in the written text.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
she finds herself displaced to the 1940s Japanese-American internment camp that her late grandmother, Ernestina, was forcibly relocated to during World War II.⏎These displacements keep occurring until
-
of the war dwarfed anything seen before in the islands. In recognition of the close ties forged between the United States and the people of Solomon Islands during World War II
-
in its water Apra Harbor grave. The Tokai Maru was a Japanese passenger-cargo ship before World War II, but after the outbreak of World War II it became a transport for the Japanese Imperial Navy. In early 194
-
75th anniversary of the Battle of Guadalcanal in Solomon Islands, which was a critical turning-point for Allied forces in the Pacific theater of World War II.⏎The two countries established diplomatic relations following Solomon Islands' independence in 19
-
to wane following the arrival of the automobile, the Interstate Commerce Commission, World War I, and the Great Depression. A brief growth spurt during World War II was short-lived, and it was followed by the collapse of several major railroads
-
It was in a roundabout way that six Challengers ordered by the UP ended up hauling coal for the Clinchfield Railroad. In the midst of World War II, the War Production Board refused the Rio Grande's request to order new articulateds
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am not a Christian, I do not think that the United States is a nation-state of the world. I am not a member of the Church of the People, I am not a member of the Church of the People. I am
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
admitted by the workhouse due to their social standing. However, the Society still needed funds to support the organisation and the small number of inhabitants who lived within the Poorhouse. By commissioning Lanyon to create a survey, they were possibly
-
context, references and techniques. The original⏎text appears after the notes. For "deep explorers" of Anglo-Saxon poetry, there⏎is an advanced Language section written by Bob Zisk, followed by a list of⏎sources for further
-
to all use restrictions contained in the Terms and Conditions of Use of the BioOne website.⏎Vol. 65 •
-
some states more economically mobile than others? This study doesn’t seek to specifically address the causes of relative mobility between states, but there are some important factors that the Economic Mobility Project has found are essential to promoting economic mobility overall, and these include things
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:212 strongly suppresses
- L0:115 excites
- L0:138 excites
- L0:300 suppresses
- L0:130 suppresses unclear: word right after a modifier
- L0:51 excites
- L0:1224 weakly suppresses
- L0:1301 weakly suppresses
- L0:337 weakly excites
- L0:178 weakly suppresses
- L0:470 weakly suppresses
- L0:36 weakly suppresses
- L0:486 weakly suppresses
- L0:2229 weakly excites
- L0:447 weakly suppresses
- L0:0 weakly excites
- L0:385 weakly excites
- L0:1855 weakly suppresses
- L0:301 weakly excites
- L0:179 weakly excites
- L0:535 weakly suppresses
- L0:222 weakly suppresses
- L0:350 weakly suppresses
- L0:369 weakly excites
Feeds later layers
- L4:0 strongly suppresses
- L2:882 suppresses
- L6:2114 suppresses
- L9:1190 suppresses
- L4:1963 suppresses
- L3:2055 suppresses
- L2:1342 suppresses
- L20:474 suppresses
- L7:29 suppresses
- L11:1194 suppresses
- L4:176 excites
- L2:932 suppresses
- L5:1935 suppresses
- L16:482 suppresses
- L17:1993 suppresses
- L2:104 suppresses
- L16:158 suppresses
- L10:1432 suppresses
- L3:1057 suppresses
- L2:1597 suppresses
- L11:1822 excites
- L13:1733 excites
- L8:219 suppresses
- L3:169 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- unj
- itations
- واجه
- 】,
- ировки
- ahi
- amedi
- tog
- ере
- 搅
Suppresses
- "--
- 瓒
- право
- Guidance
- icrosoft
- Committee
- orem
- beros
- scription
- Caucas