"about" in "what about" questions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word "about" when it follows "What" in a follow-up question, like "What about the future?". Turning it up gave wandering text that did not clearly show this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
just wasn’t much technological or scientific progress at that time.⏎What about the first decade of the 20th century? That’s easier. The
-
Fight⏎Donate today to preserve Civil War battlefields and the nation’s history for generations to come.<|endoftext|>Understand the True Health Benefits of Almonds⏎What about the health benefits of almonds? Almonds are healthy nuts and are loaded with many
-
the hearing aid is hard to remove, use a slightly damp, clean cloth. Do not use soap, rubbing alcohol or cleaning products on your hearing aids.⏎What about liquids and substances besides water?⏎Avoid exposing the hearing aid to hair products and makeup
-
just the scraps from food preparation that should be added to the heap. What about the pieces of paper, card etc that we rip up for (hopefully) recycling
-
nationalisation. But less has changed politically. The party - based on the Soviet model - runs the country in much the same way it has always done.⏎What about the future?⏎Some believe the opening up of China's economy will eventually lead to
-
majority of the studies, folks don’t get any crazier around the full moon–despite the many books and movies attesting to it.⏎Anyway, what about the link between a woman’s menstrual cycle and the lunar cycle? I mean,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been told by the same as the link. I have been told by the same as the link. I have been told by the same as the link. I have been told by the same as the link. I have been told
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
few monks who insisted on accompany him whithersoever he might go, launched his frail currochs from the northern shore. They landed first, or rather were carried by wind and stream, upon the little isle of Oronsay
-
udate winter look!<|endoftext|>While doing my own comparison of women in the New Testament and Josephus’ Jewish histories, I began to notice a theme, or rather, two themes. Each one dealing with customs involving women and since I could not
-
of the painter Charles Gleyre (1806 – 1874) (Gleyre Marc-Gabriel trained students such as Renoir, Monet, Sisley), he attended from 1875
-
and could easily be a lot more (I'm assuming here that the minimum impact speed is 11 km/sec, Earth's escape velocity; it could in fact be much higher). This probably would not cause an extinction level event for humans,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:596 weakly excites
- L0:3032 weakly suppresses
- L0:2636 weakly excites
- L1:1453 weakly excites
- L0:903 weakly suppresses
- L0:1934 weakly excites
- L1:50 weakly suppresses
- L0:140 weakly excites
- L0:1878 weakly suppresses
- L1:2312 weakly excites
- L1:435 weakly excites
- L1:1406 weakly excites
- L0:2084 weakly excites
- L1:2394 weakly suppresses
- L0:33 weakly excites
- L0:2343 weakly suppresses
- L0:1085 weakly excites
- L0:2975 weakly excites
- L0:1025 weakly excites
- L1:2231 weakly excites
- L0:1211 weakly excites
- L0:2899 weakly excites
- L0:1717 weakly excites
- L0:2468 weakly excites
Feeds later layers
- L20:903 weakly suppresses
- L16:1432 weakly suppresses
- L21:2871 weakly suppresses
- L9:1418 weakly excites
- L21:415 weakly suppresses
- L4:338 weakly excites
- L19:1351 weakly suppresses
- L3:1650 weakly suppresses
- L9:1785 weakly suppresses
- L9:1333 weakly excites
- L4:774 weakly excites
- L17:2676 weakly excites
- L16:2526 weakly excites
- L17:2565 weakly excites
- L11:338 weakly suppresses
- L26:2149 weakly suppresses
- L18:2915 weakly suppresses
- L27:2528 weakly excites
- L14:1519 weakly excites
- L5:2961 weakly suppresses
- L14:976 weakly excites
- L17:684 weakly suppresses
- L9:930 weakly excites
- L5:1992 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- GENCY
- än
- ANNER
- 연
- rer
- овор
- кцион
- HIR
- ध
- ruptcy
Suppresses
- /downloads
- ordes
- arak
- /icons
- rypt
- mp
- nga
- MP
- เสม
- intuition