word pieces inside names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the middle pieces of names split into several parts, such as the "gen" in Röntgen or the "ux" in Benelux. The steering results did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
but the 8th November actually marks 115 years since the X-Ray was first invented. The honor goes to German physics professor Wilhelm Röntgen who discovered the use of an X-Ray way back in 1895
-
. However, Humberto may later regenerate into a tropical cyclone as it moves over warmer water and away from the wind shear.⏎The Moderate Resolution Imaging Spectroradiometer (MODIS) aboard NASA’s Aqua satellite captured this true-color image of
-
Antalya-Türkiye’de doğdu. Lisans öğrenimini MSÜ Den
-
, in recent years, to constitutional amendments granting these regions formal recognition and autonomy.⏎In 1948 Belgium became a co-signatory to the Benelux Customs Union along with the Netherlands and Luxembourg. This later became the Benelux
-
to display her beauty to the people and the nobles, for she was lovely to look at.⏎As the story continues, pride creeps in.⏎Xerxes wanted to show off his beautiful wife! But it seems as though he didn’t
-
without the patient actually being cut open!⏎The discovery of x-rays was a happy accident. A physics professor named Wilhelm Roentgen was testing whether cathode rays could pass through glass and observed a mysterious light that
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I can't be in the future, I can be the future. It's about how I can be the future. It's not about how I can be the future, but it's about how I can be in the future. I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
our du.⏎- Our du is 5 -- let me circle that and let me do that in that blue color --⏎- is 5 cosine of 5x dx. So we can rewrite this entire expression as --⏎
-
you look over here, we don't have quite du there. We have just cosine of 5x dx--⏎- sorry, I need cosine of 5x dx, just like that. So when you look over here,⏎- you have
-
the commands you give and the M-file are somewhat disparate. The process is illustrated using a single, simple differential equation:⏎Integrate this equation from t = 0 to t = 1. The exact solution can be found by
-
let's think about whether u-substitution might be appropriate. Your first temptation might to said,⏎- "Hey, maybe we let u equal sine of 5x, and if u is equal to sine of 5x,⏎- we have
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:421 suppresses
- L2:49 weakly suppresses
- L3:3004 weakly excites
- L3:342 weakly excites
- L3:1726 weakly excites
- L2:988 weakly excites
- L2:1526 weakly suppresses
- L2:931 weakly excites
- L3:1605 weakly suppresses
- L3:314 weakly excites
- L2:1602 weakly excites
- L1:1997 weakly suppresses
- L0:1242 weakly excites
- L2:954 weakly excites
- L3:3053 weakly suppresses
- L0:2857 weakly suppresses
- L0:2176 weakly excites
- L1:2049 weakly excites
- L3:2523 weakly suppresses
- L0:2233 weakly suppresses
- L2:2328 weakly suppresses
- L3:91 weakly excites
- L2:2208 weakly excites
- L1:144 weakly excites "of" after abstract nouns like birth
Feeds later layers
- L9:893 suppresses
- L7:2602 suppresses
- L6:494 suppresses
- L7:1594 weakly suppresses
- L11:1175 weakly excites
- L23:1533 weakly excites
- L12:2612 weakly excites
- L6:2988 weakly excites
- L24:1810 weakly suppresses
- L14:287 weakly excites
- L8:819 weakly suppresses
- L20:1913 weakly suppresses
- L5:939 weakly excites
- L12:85 weakly suppresses
- L22:2847 weakly excites
- L6:29 weakly suppresses
- L10:1485 weakly suppresses
- L20:1807 weakly excites
- L10:2002 weakly suppresses
- L26:842 weakly suppresses
- L24:1534 weakly suppresses
- L6:2638 weakly suppresses
- L14:2428 weakly excites
- L6:3044 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- �试
- throat
- AdapterFactory
- SWG
- ่น
- rooms
- BED
- consequential
- 篷
- adoras
Suppresses
- othy
- ãi
- etz
- ily
- "$
- 社会
- udu
- 的社会
- (DataType
- socially