comma after 'For X,' introducing a viewpoint
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that follows a phrase like "For an amputee," or "For dairy producers,", where the writer is about to say how something looks or feels from that person's point of view. Steering it did not produce text that clearly reflected this, so the link is only seen in the examples.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of the most common questions I get is, “Why do we separate the calves from their mums?”⏎These questions invariably come from mothers. For dairy producers, this is so much a part of
-
and universities across the country.⏎In Pakistan, schools, colleges, and universities are considered to be safe spaces for learning and personal growth. However, for many students, these institutions can become a source of fear, anxiety
-
their cute googly eyes.⏎The world looks colorful to our eyes with only three color receptors — red, green, and blue. But for a mantis shrimp, a small marine crustacean with 12 color receptors, it looks quite
-
or a performance; it really did upset the general.⏎Then his long, tall shadow fell across the young Hoosier from northern Indiana. For Private Kuhl, it must have felt like
-
⏎A new breakthrough in prosthesis has delivered a bionic hand that is capable of feeling just like the organic limb it replaces.⏎For an amputee, replacing a missing limb with a functional prosthetic can alleviate physical or emotional distress and
-
. Dance is one of the most human activities ever created and, luckily for us, it’s not going away any time soon. For Physie girls and women, dancing is like breathing, eating and sleeping… it’s a necessity!⏎One answer
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
events,” he says. “That’s just what creationists say can’t happen.”’1⏎The many comments posted on the New Scientist website shows just how excited the atheists are about this report. They are positively gloating.⏎In 1
-
. MTBE has been detected about 4 to 6 times more frequently in the high-use areas than elsewhere.⏎In addition to its studies of ambient ground water, USGS is<|endoftext|>
-
’s death on the Cross, descent into Hell, and the Resurrection.⏎Reproaching the lack of penitence and recalcitrance of the Jews, the Lord said, “The Ninevites shall rise in the judgment with this
-
ization as a World Church.”1 The Council marked the definitive end of European influence and domination of the Catholicity of the Church. With farsighted acumen, Rahner suggested that the process of creating an authentically polycentric World
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:1835 excites
- L6:2326 suppresses
- L9:2070 suppresses
- L11:487 excites
- L9:1627 excites
- L13:1535 suppresses
- L13:2636 suppresses
- L12:1352 suppresses
- L12:1667 excites
- L9:1550 excites 'to' after 'matters' or 'means' phrases
- L8:1703 excites
- L7:194 excites
- L9:2202 weakly suppresses
- L6:1001 weakly suppresses
- L12:2347 weakly suppresses
- L13:287 weakly excites
- L5:247 weakly suppresses
- L13:2465 weakly suppresses
- L3:1956 weakly suppresses
- L13:1100 weakly suppresses
- L13:541 weakly excites
- L3:520 weakly suppresses
- L5:2987 weakly suppresses
- L6:1637 weakly excites
Feeds later layers
- L16:1219 strongly suppresses
- L15:2005 suppresses
- L16:1441 excites
- L20:862 suppresses
- L18:1629 suppresses
- L16:2208 suppresses
- L15:1919 excites
- L15:947 suppresses
- L16:1382 suppresses comma after an introductory phrase
- L18:2708 suppresses
- L15:1226 suppresses
- L18:1199 suppresses
- L15:942 excites
- L17:1471 suppresses
- L17:2546 excites
- L15:3044 suppresses
- L15:1771 suppresses
- L18:1576 suppresses
- L15:2633 suppresses
- L19:2508 suppresses
- L18:1584 suppresses
- L18:2195 suppresses
- L16:1998 suppresses
- L16:564 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ch
- Interr
- interruption
- enburg
- ky
- ime
- interceptions
- 打断
- 和服务
- ража
Suppresses
- scientists
- 科学家
- chàng
- ]: ⏎
- xFFFFFF
- Bosch
- aders
- 统计局
- */ ⏎
- exels