'for' introducing an example or reason
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the word 'for' when it starts a phrase like 'for example', 'for instance' or 'for several reasons'. It is quiet, and slightly negative, on 'before' in phrases like 'But before that'. Steering results did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
⏎The Negotiator Magazine November 2014<|endoftext|>In most homes, regardless of parenting style, arguing with the kids is not encouraged. In fact, for most of us, it
-
lead too far afield; but it is clear from all that is known of the<|endoftext|>Obese & Fat German Shepherd⏎Like humans, dogs can become obese for several reasons, and the effect is just as severe in them. German Shepher
-
/or less comfortable expressing themselves via words. Art Therapy is also known to help people with social skills, specifically, those that are withdrawn or shy, or who, for one reason or another, have a difficult time functioning within social situations.⏎Why art
-
levels of exposure to other cultures and those with low levels of domestic alternatives. Small countries that have experienced struggles with outside countries through political, military and social events, for example, are more likely to carry those negative feelings to the marketplace when it comes
-
understanding of each other’s environmental problems and to explore opportunities for positive action, individually and collectively.”⏎Other nations were far more skeptical. France and the United Kingdom, for example, were<|endoftext|>Diseases & Conditions⏎If you trim your toenails
-
.S., we have a number of ethnic nations, most, if not all, being Amerindian in nature. But, citizens of the Navajo nation, for instance, have their own police force and legal system. To be a member of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: that that, in doing so, that, that, that, that, that, that, that, that, that, that, that, that, and that, that, that, that, that, and then, that, that
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Thomas Edison Pitch Contest⏎The Thomas Edison Pitch Contest was created in 2010 as a competition to showcase and encourage invention, innovation and entrepreneurship among students before they get to college. Every year, students submit their great ideas to win prizes
-
new growth add further ornamental interest. Sun-loving Japanese tree lil<|endoftext|>At present, there are several political parties in India are providing social responsibilities towards society. But before the party, we do not have known or seen the previous Congress, the Indian
-
winds will be fierce. The sun will be of no use. Three of these winters will come, one after the other, with no summer in between. But before that, there will have
-
the bin, consider feeding them to animals.<|endoftext|>Student Vote Program Evaluation⏎To educate young Canadians about democracy and elections and to help them develop the habit of voting before they turn 18, Elections Canada has worked with Student Vote to provide students
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:2336 excites
- L9:1890 excites
- L4:1035 suppresses 'for' after verbs like 'fall' or 'click'
- L3:381 weakly excites 'for' in research institute names
- L10:132 weakly excites
- L8:705 weakly excites
- L15:1838 weakly suppresses
- L15:906 weakly suppresses
- L6:2320 weakly suppresses
- L0:2365 weakly suppresses mid-word pieces like 'advent' and 'precaution'
- L6:617 weakly suppresses
- L5:697 weakly suppresses
- L5:1090 weakly excites
- L5:501 weakly excites
- L3:2256 weakly suppresses
- L5:2269 weakly suppresses
- L15:280 weakly excites
- L11:1868 weakly excites
- L0:1183 weakly excites
- L15:1974 weakly excites
- L5:148 weakly suppresses
- L5:1041 weakly excites
- L11:210 weakly excites
- L5:273 weakly suppresses
Feeds later layers
- L21:1722 weakly excites
- L18:1617 weakly suppresses
- L18:2673 weakly excites
- L24:1243 weakly suppresses
- L18:1389 weakly suppresses
- L18:1775 weakly suppresses
- L19:1914 weakly suppresses
- L21:2473 weakly excites
- L23:1858 weakly suppresses
- L26:2344 weakly suppresses
- L23:2862 weakly suppresses
- L24:2210 weakly suppresses
- L27:1075 weakly suppresses
- L21:1546 weakly suppresses
- L20:2745 weakly excites
- L19:1050 weakly excites
- L23:508 weakly excites
- L19:2727 weakly excites
- L24:1352 weakly suppresses
- L21:1533 weakly suppresses
- L19:2786 weakly excites
- L21:741 weakly suppresses
- L18:1391 weakly excites
- L18:2938 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ally
- альным
- iado
- away
- plays
- ulate
- erten
- holes
- альные
- aside
Suppresses
- sworth
- .fc
- FRAME
- úc
- fov
- 驷
- 亲眼
- еств
- จบ
- imits