surname pieces split across tokens
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the middle piece of a surname that the model has split into several chunks, such as the 'og' in Cogliano or the 'ohn' in Bohn. Turning it up made the model's writing wander without any clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
<|endoftext|>It’s official: “…recalls for vaccines and immunoglobulins were higher than other drug classes,” per a recent 72-page report by GBI Research, published March 14, 2012. That report
-
turns the receptor on is slightly different," says Dr. Aashish Manglik, a researcher at Stanford University School of Medicine who studies opioid receptors.⏎After Bohn's discovery, a number of people, including a team that includes Manglik,
-
April.⏎- Angus Deaton & Olivier Dupriez, 2009. "Purch<|endoftext|>Of Biochemistry and Belief⏎by William Bole⏎Pope John Paul II's recent statement that evolution is more than⏎just
-
016.⏎These media resources form part of an on-demand Coursera MOOC run by Frank Cogliano; Professor of American History, David Silkenat; Lecturer,
-
in sexual behavior, Lenz and her colleagues silenced the cells in male fetal rats and then observed the rats’
-
while playing outside, and he wasn’t sweating enough to properly cool down.⏎The boy, who has autism, was taking several medications — Seroquel, Cogentin and Benadryl — all of which can change the body’s response
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: $ f(x) = -2x^2 + 2x^3 + x^4 + x^5 + x^6 + x^7 + x^8 + x^9 + x^10 + x^
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the successful deflection of a shot by touching part of the ball on its way to the basket, thereby preventing a field goal⏎Một loại quần short ống rộng vừa vặn, dệt kim hoặc quần soóc nam thường được
-
first Shogun was still a good 800 years after the Splitting of Irritaria and Hachiman was probably ruled by an Emperor/ress before the Shoguns took complete power. Samurai probably existed well before the appearance
-
932 as the difference in pressure between Ponta Delgada on the Azores and Stykkisholmur in Iceland. More information on the NAO can be found here. See also Arctic
-
Education's Institute of Education Sciences to provide educators, policymakers, and the public with a central and trusted source of scientific evidence of what works in education. The WWC is administered by the Department, through a contract to a joint venture of the American
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1417 strongly suppresses
- L2:239 strongly suppresses
- L1:831 strongly suppresses
- L3:1005 suppresses
- L1:2283 excites
- L0:258 excites
- L2:1101 suppresses
- L1:637 excites
- L0:597 suppresses
- L0:667 excites
- L1:1256 excites
- L3:1688 excites
- L0:2551 excites
- L1:1533 suppresses
- L0:465 suppresses
- L2:964 suppresses
- L3:861 excites
- L1:230 weakly suppresses
- L1:1524 weakly suppresses
- L3:50 weakly excites
- L1:663 weakly excites
- L2:1764 weakly suppresses
- L1:1336 weakly suppresses
- L1:2606 weakly suppresses
Feeds later layers
- L16:471 strongly excites blank spot before a year
- L18:649 strongly excites
- L7:432 strongly excites
- L25:422 excites
- L19:737 excites
- L6:349 excites
- L16:2002 excites
- L18:1671 excites
- L19:479 excites
- L15:496 excites
- L18:185 suppresses
- L17:666 excites
- L6:1699 excites
- L22:2384 excites
- L26:2003 excites hyphen joining two word parts
- L5:139 excites
- L26:254 suppresses
- L22:174 suppresses
- L21:2617 excites
- L6:394 suppresses
- L22:265 excites
- L20:396 excites the D in 3D or 2D
- L19:548 weakly excites
- L26:725 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- phans
- ayas
- pen
- otype
- igation
- nog
- our
- **)&
- "S
- =S
Suppresses
- Won
- ⏎ ⏎
- hom
- mortar
- cly
- JOR
- _inactive
- uParam
- -thirds
- taste