'should' in advice and claims
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires strongly on the word "should", especially in phrases like "should not be confused" or "should be diagnosed". Turning it up made the text more likely to shift into "should" statements about what ought to be done, but only in one of the four prompts.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the Polish Cossacks (Kozacy) and the Tatar Cossacks (Nağaybäklär). The name “Cossack” should not be confused with Kazakhs (native to Kazakhstan, a country in Central
-
of the major components of the forward price index methodology. Variable cost index also known as VAT, is often confused with the expression “cost of good sale” which should not be confused as the same thing. The main difference is that the first expression
-
facial swelling) and respiratory (e.g. wheezing) issues. In severe cases, anaphylaxis can occur.⏎Cow’s milk allergy should be diagnosed by a registered clinical expert who will assess the detailed clinical history in combination
-
that the influenza A virus can be transmitted to mammalian species such as tigers and domestic cats and dogs through ingestion of infected birds. Another group of animals that should also be considered as potential hosts for the influenza A virus is the crocodilians
-
Siberian Yeti implanted by the Russians as a spy, I would suggest that was satire. Both the source and the content suggest that it is not something which should be believed.⏎On the other hand, when a Fox news anchor claimed he
-
reference to the darker, streaked heartwood found in some Ash trees, which tends to resemble the wood of Olive trees in the Olea genus. And it should come as little surprise that Olive Ash can be a dead ringer for actual Olive
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I want to have the same number of 100000011110011110011100001000100010010
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
grams of protein. It also gives details per 100g: 3.2g of protein. Aha! I could - if I needed to, figure out how much a portion weighs using proportion! It’s time for the
-
habits like too much taking of processed food and large quantities of fried food ,which can harm your liver in the long run.⏎- So, the liver requires a proper amount of vitamins, minerals, and antioxidants to improve its functions. The role of
-
the disabled, the unemployed and similar groups of people are to be taken care of in a welfare state. It has the duty of eliminating economic inequalities to ensure a reasonable and equitable standard of living, to all citizens of the state.⏎Education, health
-
is going in. Education is serious, many other countries are way ahead of us and we are falling behind. We have rising educational costs with colleges, which require effective solutions to ensure that we have educated adults entering the work force, without the funds
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:2226 suppresses
- L7:1569 excites
- L4:2008 excites 'to' after 'have got' or 'will have' (obligation)
- L16:2349 suppresses
- L15:886 excites
- L5:371 excites
- L10:2166 excites
- L9:640 suppresses
- L5:2538 excites
- L5:387 excites
- L13:1272 excites
- L10:1125 suppresses
- L13:909 excites 'to' before a verb after a noun
- L11:2224 excites
- L14:1309 excites
- L7:1056 excites
- L3:3037 suppresses
- L10:2233 suppresses
- L10:562 excites
- L16:2304 suppresses
- L14:2077 weakly excites
- L5:1917 weakly excites 'to' after 'what' or 'where' (what to do)
- L9:1848 weakly suppresses
- L6:2057 weakly suppresses
Feeds later layers
- L18:522 excites
- L18:1162 excites
- L19:1709 suppresses
- L19:1294 excites
- L21:1906 excites
- L21:2990 suppresses
- L18:2568 excites
- L19:1824 excites
- L20:2395 excites
- L27:1123 suppresses
- L19:2282 weakly excites
- L18:1481 weakly suppresses
- L18:2733 weakly excites
- L18:700 weakly suppresses
- L24:764 weakly suppresses
- L21:2252 weakly excites
- L20:2134 weakly suppresses
- L20:2858 weakly excites
- L22:1487 weakly excites
- L19:2433 weakly excites
- L18:717 weakly excites
- L21:1575 weakly excites
- L19:1850 weakly excites
- L22:2001 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- tein
- 考虑
- 结晶
- ndo
- be
- �性
- ��
- beware
- 恙
- .clip
Suppresses
- 需要
- 需
- orer
- 你需要
- :::
- bor
- filtr
- needs
- 都需要
- oris