'key' after 'The'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires very strongly on the word 'key' when it follows 'The', as in 'The key to' or 'The key is'. It is slightly negative on 'of' after 'interior'. Turning it up or down did not make the model's writing talk about keys or important points.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
The key here is precisely the geography that cannot be seen from above: the underwater domain where
-
interiors even when the windows are closed. Designs often incorporate atria or internal stairwells to take advantage of these effects.⏎Winter environmental ventilation⏎The key issue for winter environmental ventilation is the control of indoor air quality. Experience shows that
-
or reply design paradigm for synchronous and asynchronous applications. An application’s business logic or individual functions are modularized and presented as services for consumer or client applications. The key to these services is their loosely coupled nature; i.e., the service interface is
-
⏎- ‘The key to making the discovery was the development of new techniques that allow monosynaptic
-
but keeps coming back.” Or “I took (said extended period of time off) and it still didn’t help and I have the same pain!”⏎The key component that is missing from most therapy programs is the strengthening aspect. Yes, the
-
working with a personal trainer.⏎This guide’s main goal is to help you become more active, get the most from your activities, and do them safely. The key is to know your starting point and build slowly from there. Knowing your starting point
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of the universe. It's a place where the stars are dancing in the sky. It's a place where time flies in the air. It's a place where everything is possible. It's a place where the universe is a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of Liberty.The interior of the structure is a collection of wrought iron rivets, saddles and armature
-
varying shades of pink, yellow and creamy white. The interior of the lip is richly feathered, and is dark crimson. The rich contrast
-
. While Grant set out to destroy Lee’s army, Sherman was ordered to move against Johnston’s army and also to do as much damage as possible to the interior of Georgia.⏎Sherman interpreted his orders as allowing him to concentrate on the capture of
-
The completed rest house on the opening day⏎A typical bedroom in the rest house⏎Inside
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L2:330 excites
- L3:774 excites
- L19:1019 weakly suppresses
- L1:176 weakly excites
- L5:613 weakly excites
- L22:848 weakly excites
- L1:697 weakly excites
- L18:1580 weakly suppresses
- L19:2444 weakly suppresses
- L1:233 weakly excites
- L19:1645 weakly suppresses
- L6:604 weakly excites
- L14:866 weakly suppresses
- L10:315 weakly suppresses
- L2:91 weakly suppresses
- L1:2209 weakly suppresses
- L17:1967 weakly excites
- L22:770 weakly suppresses
- L12:665 weakly suppresses
- L20:987 weakly suppresses
- L9:837 weakly suppresses
- L16:151 weakly excites
- L24:1137 weakly excites
- L17:359 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- وس
- ought
- Fabric
- renc
- React
- igli
- ranch
- ront
- 秘密
- 养老服务
Suppresses
- containing
- powered
- bourg
- Uhr
- currentItem
- 全套
- humanities
- бур
- огда
- courier