'not' in 'if not' hedges
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "not" in phrases like "if not the most important" or "if not impossible", where a writer qualifies a claim by saying something stronger. It is one of the clearest patterns in this set, though turning it up made the model's text wander rather than show this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
is one of the most important, if not the most important, metrics in valuing the bond.⏎Now, let's look
-
eating plan.⏎Beyond promoting every nutrition expert’s mantra of “eat more vegetables and fruits”, the standard raw food diet is true to its name – most, if not all, foods need to be “raw”. This means dieters are prohibited from
-
0 years at one level of relative sea-level rise, when they should be building projects that can function for several generations as sea level rises twice as high, if not higher.”⏎Garret Graves, head of the state Coastal Planning and Protection Authority,
-
tanks, large flags, chest thumping marches, discipline-for-itself and martyr walls help inspire nationalism and patriotism? This becomes a particularly good question, if not a surprising one, because, historically speaking, ideas of nationalism and patriotism have never
-
<|endoftext|>Climate change is one of, if not the biggest challenge we all currently face. It can be difficult and confusing to know
-
and shouldn’t!) take my word for it – the following is from a very recent review by leaders in this field:⏎"...epigenetic inheritance is usually—if not always—associated with transposable elements, viruses, or transgenes and may be
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: another, more, another more, more is more, MORE AND MORE MORE. MORE AND MORE. MORE AND MORE. MORE AND MORE. MORE AND MORE NMORE. MORE AND MORE NMORE. MORE AN MORE AN MORE. MORE AN
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, religion, the right to hold public office and the right to vote. Also a place where government is by the people and for the people. The United Kingdom is a representative democracy. This means that everyone over
-
1988413967-1-768x146-1-300x57.png 0 0 admin https://
-
Mother of Sons⏎I will go into the Mother of Seven Sons first. As far as I can tell, they both sprang from the same War to End all Wars, against the Greek King Antiochus Epiphanes who decided
-
well as improve their athletic skills. They work cooperatively playing soccer, badmitton, frisbee, bean bag bowling and other games.⏎17 Views 20 Downloads<|endoftext|>In Key Stage 1 the children will:⏎The five enquiry
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2662 excites
- L10:2859 excites
- L8:2278 suppresses
- L12:2132 suppresses
- L12:1481 excites
- L12:2983 excites
- L9:1655 excites
- L6:923 suppresses
- L6:1332 excites
- L12:2418 suppresses
- L12:1244 weakly excites
- L12:2770 weakly excites
- L10:1387 weakly excites
- L3:1537 weakly excites
- L0:567 weakly excites
- L4:182 weakly suppresses
- L8:991 weakly suppresses
- L10:2314 weakly excites
- L12:136 weakly suppresses
- L5:2049 weakly suppresses
- L11:2684 weakly suppresses
- L3:716 weakly excites
- L0:60 weakly excites
- L0:2153 weakly suppresses
Feeds later layers
- L18:1882 strongly suppresses
- L16:1921 strongly suppresses
- L15:2186 suppresses
- L17:1679 suppresses
- L17:2572 suppresses
- L18:1765 suppresses
- L15:2808 suppresses
- L20:516 suppresses
- L15:2915 suppresses
- L18:2772 suppresses
- L15:1818 suppresses "own" in reflexive phrases
- L18:2113 suppresses
- L19:2642 suppresses
- L18:1572 weakly suppresses
- L15:3069 weakly suppresses
- L17:444 weakly suppresses
- L17:129 weakly suppresses
- L15:1173 weakly suppresses
- L15:1037 weakly suppresses
- L16:1408 weakly excites
- L17:1927 weakly suppresses
- L17:429 weakly excites
- L25:170 weakly suppresses
- L16:1868 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- otive
- oting
- ote
- 飙
- gest
- izontal
- itness
- ation
- isory
- ulated
Suppresses
- `;⏎
- `);⏎
- .`);⏎
- `);⏎⏎
- `;⏎⏎
- "`⏎⏎
- 涤
- 处处
- --;⏎⏎
- .${