'to' after 'unable'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires strongly on the word 'to' right after 'unable', as in 'unable to recall' or 'unable to venture out'. It is very consistent on that phrase. Turning it up or down did not produce an obvious change in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
black-throated gray warbler is exclusively western in distribution, from our southern border to British Columbia. Though I have seen it many times, I am unable to recall any especially salient characteristics possessed by the species. Like others of the family
-
romantic relationship with Mayor Guillén de Guzmán who bore to him an illegitimate daughter Beatrice.⏎Due to Violant's young age, she was unable to get pregnant for several years. Alfonso came to believe that his wife was
-
elasticity. As the temperature falls, the rubber continues to lose flexibility and its ability to resist abrasion, impact, and cutting. Eventually, the belt is unable to trough and pass around pulleys. The covers and the rubber between the plies
-
it comes to protecting the body from infection. When germs get onto our skin or into a cut or other break in the skin’s surface, they are unable to invade deeper into body tissues due to the acid mantle (pH) of our
-
are lacking and can lead to psychological wounding associated with shame and loneliness.⏎Growing awareness of this trait has generated much inquiry, yet psychologists have so far been unable to agree on a single defining attribute. If you identify with the description, there are
-
óa last resort in case of a grizzly charge. The bears were obviously aware of my presence, but upwind, and in the dark, they were unable to locate my exact position. After over a minute of intense sniffing and scanning,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
th century? That’s easier. The Zeppelin airship. The first modern vacuum cleaner. The first aeroplane. The vacuum tube diode. Bakelite.⏎And what about the first decade of the 21st century? The
-
impulsively and irrationally. Salekin uses a laptop computer and LCD player to explain brain plasticity and how they can
-
News | Troubled youth in the custody of the Alabama Department of Youth Services have been given a second chance at success thanks to the work of Dr. Randy Salekin, a professor in the Department of Psychology
-
troubled youth at the facility than typical methods, like empathy training or strict discipline. The treatments were tested at UA’s Disruptive Behavior Clinic in advance of Salekin’s partnership with DYS.⏎The teens and pre-teens Salekin and his
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:2989 suppresses
- L0:178 suppresses
- L0:1301 suppresses
- L0:2870 weakly suppresses
- L0:1224 weakly suppresses
- L0:1343 weakly suppresses
- L0:644 weakly suppresses
- L0:2743 weakly suppresses
- L0:2585 weakly suppresses
- L0:2563 weakly excites
- L0:2111 weakly suppresses
- L0:1256 weakly suppresses
- L0:1743 weakly excites
- L0:2078 weakly excites
- L0:1713 weakly excites
- L0:963 weakly suppresses
- L0:2911 weakly suppresses
- L0:1715 weakly excites
- L0:1483 weakly excites
- L0:1766 weakly suppresses
- L0:589 weakly excites
- L0:718 weakly suppresses
- L0:1581 weakly excites
- L0:791 weakly excites
Feeds later layers
- L16:2754 excites
- L15:786 excites
- L15:1104 excites
- L17:443 excites
- L14:1859 excites
- L17:1917 excites
- L16:1828 excites
- L4:9 excites
- L13:383 excites
- L21:1349 excites
- L20:2810 excites
- L15:519 excites
- L4:1512 excites
- L9:3000 excites
- L9:54 excites
- L19:1301 excites
- L17:2492 excites
- L16:1692 excites
- L8:140 excites
- L16:1221 excites
- L16:752 excites
- L21:1970 excites
- L16:697 excites
- L23:2518 excites sentence-initial 'Not' starting a clause
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 打扰
- trầm
- hề
- 征求意见
- intage
- riers
- phony
- artz
- ocrat
- ocurrency
Suppresses
- asts
- arDown
- nets
- апр
- казалось
- izations
- несен
- nm
- Sap
- iedades