comma closing 'the more X, the more Y' clauses
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma at the end of a 'the more you do this' phrase, just before the second half of the sentence that starts with 'the more'. Turning it down made the model get stuck repeating the word 'more'.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
few (or 30) seconds or your water’s a couple degrees off temperature, you’re NOT going to ruin your film. The more accurate you are,
-
this is done, the company loses vital manufacturing and quality information. This information accurately collected is the only basis of implementing quality improvement. The more granular the information, the more effective it can become.⏎If the only options are in-tolerance and
-
spinning shaft. The propeller is attached to that shaft. At least two (but usually three or four) blades make up the propeller. The more blades, the more air that can be moved by the propeller. A blade has an
-
are being used to validate this identity combination, and to prove a virtual person is indeed the same person in real life. The more value an identity has access to, more effort and work is required to validate and establish secure authentications for it.⏎
-
stress.⏎Stress is an underlying factor in illness as it reduces your immune system’s ability to fight off antigens. This means that the more stressed you are, the likelier you are to pick up infections and fight illness.⏎Therefore, a
-
, to a jog in the 20th century, to a sprint now.⏎The reason for this is simple. The more technology you have at your disposal, the easier it is to invent new things. Imagine trying to build a computer using
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
played by the unpredictable in war,” Thucydides wrote, “and think of it now, before you are actually committed. The longer a war lasts, the more things tend to depend on accidents. Neither you nor we can see into them
-
that there are 10 billion trillion stars in the Universe, but the fact is, they will never know for sure. The deeper into space we look, the more stars we fi nd. How remarkable it is to think our
-
it important that it be crowned and formally installed at the Shrine of Christ the King in Chicago, IL by Cardinal George? A. "The more you honor Me the more I will bless you" is the promise of the Infant King. The coron
-
once you see the incredible benefits you could never look back. It cooks your food and keeps it piping hot. The more you incorporate it into your daily life, the more you will find you use it.⏎A degree of experimentation is necessary to get
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:3019 strongly suppresses
- L20:2321 strongly excites
- L20:2323 excites
- L20:944 excites
- L19:1430 excites 'the more X' clause before 'the more'
- L19:2597 excites
- L19:2024 excites
- L20:2852 excites
- L20:2580 excites
- L20:2477 suppresses
- L18:2761 excites
- L20:2491 suppresses
- L17:2344 suppresses
- L18:2316 excites
- L18:2875 excites
- L20:885 suppresses 'and' joining paired words
- L20:2564 weakly excites
- L17:2278 weakly excites
- L18:824 weakly suppresses
- L19:2747 weakly excites
- L9:900 weakly excites
- L18:2814 weakly excites
- L19:196 weakly suppresses
- L18:2935 weakly excites
Feeds later layers
- L26:551 strongly suppresses
- L24:847 strongly suppresses
- L27:948 strongly suppresses
- L27:1896 strongly suppresses split names and comparative stems
- L22:1630 suppresses
- L27:1734 suppresses
- L26:1908 suppresses
- L23:456 suppresses
- L25:2908 excites
- L24:2350 suppresses
- L22:1988 suppresses "the" in "the more..., the more" phrases
- L22:1700 suppresses
- L25:1046 suppresses
- L25:1196 suppresses
- L23:3034 weakly suppresses
- L26:124 weakly excites
- L23:380 weakly suppresses
- L25:884 weakly suppresses
- L27:2471 weakly suppresses
- L23:875 weakly suppresses
- L25:461 weakly suppresses
- L22:872 weakly excites
- L23:939 weakly suppresses
- L24:1488 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- iesen
- .patch
- modo
- arend
- ילת
- ulg
- led
- .inject
- ulous
- regation
Suppresses
- more
- 更
- 更多
- 更多的
- more
- 更
- 更有
- 更为
- More
- 更强