'is' after a topic noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'is' (or 'are') right after a phrase that names a topic, like 'One of the most common uses of this calculation is' or 'The exception to this is'. It is waiting for the sentence's main point to come next. Turning it up made the model's writing wander into generic, repetitive phrases about 'the most important thing'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, but the⏎site also needs to let engineers access the information they need⏎in as few clicks as possible. The one component engineers have in⏎short supply is time,” shares Kevin Hess, Mouser
-
copyright of the author of that content. To comply with copyright law, you must receive permission from the copyright holder before you download any content. The exception to this is Fair Use. As in copying printed material such as books in the library, you
-
% is the same as 25/100 and equivalent to 0.25 . One of the most common uses of this calculation is when purchasing a product on sale.⏎Thus, if the marked price is 1
-
yoga) may also be considered. The other common treatment option is surgery, which consists of two different types: open release and endoscopic surgery.⏎
-
of the main concerns about PET bottles is the potential for chemicals to leach from the plastic into the contents of the bottle
-
switch that can be controlled at room temperature and that will hold its position without the need for any electricity at all. The only real downside to it thus far, is that it takes far more energy to make the switch move than does conventional non-m
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: and the most important thing to the most important thing to the most important thing to the most important thing to the most important thing to the most important thing to the most important thing to the most important thing to the most important thing to the most
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
army units as a pastime when not at war – the process of capturing the beasts is recorded in several Roman mosaics.⏎The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If
-
peaceful world. But if the war continues, the world will be destroyed. War occurs when countries are not satisfied with what they have. They always want more which is a necessary to them. Their wish to rule other countries and widen their empires
-
.⏎What Is Thrombosis?⏎Thrombosis is when the body forms a blood clot inside a blood vessel. A blood clot in a blood vessel is also called a thrombus. A thrombus can stop blood flow to parts of
-
and they are the lock and key model and induced fit hypothesis.⏎- The shape of the active site is determined primarily by the tertiary structure of the protein, which is why the bonding and interactions between the R groups of the amino acids must be correct
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:897 excites
- L6:2237 excites
- L6:1567 excites colon introducing a summary point
- L9:97 excites
- L13:948 suppresses
- L6:2572 weakly excites
- L12:1222 weakly suppresses
- L3:367 weakly excites
- L13:1129 weakly excites
- L2:884 weakly excites
- L10:272 weakly suppresses
- L13:287 weakly suppresses
- L11:1667 weakly excites
- L8:376 weakly excites
- L1:444 weakly suppresses
- L11:2733 weakly excites
- L13:612 weakly suppresses
- L9:84 weakly suppresses
- L12:850 weakly suppresses
- L3:56 weakly excites
- L1:644 weakly suppresses
- L3:1043 weakly suppresses
- L9:1059 weakly excites
- L9:492 weakly suppresses
Feeds later layers
- L17:1171 suppresses
- L16:2790 excites
- L17:2380 excites
- L16:1535 excites
- L16:2743 suppresses
- L22:3024 weakly suppresses
- L17:143 weakly excites
- L18:194 weakly excites
- L20:2026 weakly suppresses
- L16:1739 weakly suppresses
- L21:2473 weakly suppresses
- L17:2684 weakly excites
- L15:1299 weakly excites
- L16:1267 weakly excites
- L19:2730 weakly suppresses
- L24:1650 weakly excites
- L16:316 weakly excites
- L16:2067 weakly excites
- L16:2444 weakly suppresses
- L17:156 weakly suppresses
- L17:218 weakly excites
- L15:1851 weakly suppresses 'that' after a noun, 'being' in passives
- L18:92 weakly excites
- L17:255 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 那就是
- ancias
- 的就是
- 一个是
- (express
- Orden
- :start
- →Schema
- Orden
- ElementType
Suppresses
- ipur
- �
- hevik
- 最长
- Islamabad
- ormal
- LGBT
- ấu
- تد
- nier