"of" in "Battle of"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "of" in battle names like "Battle of Midway" or "Battle of Gettysburg". Turning it up did not give a clear theme, and the output drifted into lists of numbers or unrelated sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
), attaching the choline groups to the tips of the “branches”. The<|endoftext|>This month marks 50 years since the Battle of Ia Drang Valley, the first major fight between the U.S. Army
-
6 min 1 sec Sound:Yes⏎German campaign during The Battle of Crete. Troops establish camps in Crete. They open tents and light
-
US had stopped the Japanese ships from supporting an invasion of Port Moresby, New Guinea, and the proposed air assault on Australia.⏎Next came the great Battle of Midway in June, again between United States and Japanese ships. This time US
-
of this aircraft", describes Quick. "The Canadians used it to great effect both during Normandy during the softening up and post-landings for the Battle of Caen.”⏎The aircraft was actually discovered in the United States after the war and
-
from avenue parking|⏎The North Carolina Monument is a North Carolina memorial of the American Civil War commemorating the 32 Carolina regiments in action at the Battle of Gettysburg. The monument is a public artwork by American sculptor G
-
of Donauworth in Bavaria following the swift but costly Battle of Schellenberg. When the French and Bavarians avoided further battle or negotiation,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 -
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Use ANOVA – single factor in Excel’s Data Analysis ToolPak to test whether there is a relationship between the two variables. Use an alpha of 10% Show your hypotheses, ANOVA output, and decision – referring to
-
earnings up by more than $400,000 compared to an average teacher. The symmetry of the calculations prevail: A poor teacher at the 16th percentile (100-84) produces a negative
-
) you will obtain your answer:⏎F'(x) = 2x√(1+x6)⏎Comment. There is no need to integrate and then differentiate by x
-
of capital, or they will invest elsewhere.⏎The following is the WACC calculation formula:⏎WACC = E/V × Re + D/V × Rd × (1 - Tc)⏎Re = cost of equity⏎Rd = cost of debt
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1671 excites
- L20:2892 excites
- L6:2390 excites
- L17:1166 excites
- L18:266 suppresses
- L0:3051 excites
- L18:2084 suppresses
- L14:1272 weakly excites
- L18:2436 weakly suppresses
- L18:1713 weakly excites
- L19:2968 weakly excites
- L17:1062 weakly excites
- L6:1645 weakly excites
- L8:2641 weakly excites
- L11:1401 weakly excites
- L18:831 weakly excites
- L20:1927 weakly excites
- L19:1968 weakly suppresses
- L19:2046 weakly suppresses
- L14:333 weakly suppresses
- L20:1008 weakly suppresses
- L16:1480 weakly suppresses
- L8:2364 weakly excites
- L8:2741 weakly suppresses
Feeds later layers
- L23:520 suppresses
- L22:1577 suppresses
- L23:304 suppresses
- L22:1128 suppresses
- L24:1928 weakly suppresses
- L25:2337 weakly suppresses
- L24:2174 weakly excites
- L24:1742 weakly excites
- L22:611 weakly suppresses
- L24:1710 weakly suppresses
- L25:2964 weakly excites
- L25:749 weakly suppresses
- L22:1298 weakly excites
- L26:99 weakly excites
- L26:1730 weakly suppresses
- L27:1131 weakly excites
- L23:544 weakly excites "Great" in proper place names
- L25:1250 weakly suppresses
- L22:1672 weakly suppresses
- L24:2964 weakly excites
- L22:2280 weakly excites
- L25:457 weakly suppresses
- L23:1894 weakly suppresses
- L25:2550 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- atak
- енко
- 围
- suburbs
- buch
- outer
- ictory
- ongan
- ucher
- ahren
Suppresses
- minus
- ancest
- .addRow
- personals
- .configureTestingModule
- .addChild
- ễ
- -parent
- +a
- 働