'all' or 'every' before a group
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word "all" or "every" when it comes before a group of things, like "all types of oaks" or "every continent". Its weaker negative side fires on words like "otherwise" and "ever". Turning it up gave text that drifted off topic and did not show the pattern clearly.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. For example, Maples are plagued by Maple Spider Mites and Honeylocust by Honeylocust Spider Mites.⏎Oak Spider Mites in particular attack all types of Oaks; however, pin oaks and willow oaks tend to
-
as a natural meat tenderizer. In addition, bromelain may also induce a prickly sensation in the mouth when consumed.⏎Although the enzyme is present in all parts of the pineapple plant, it's most concentrated in the stem, the hard
-
going through changes into your 20s, you generally gain more maturity when you are 18 or<|endoftext|>Menopause is a natural process that occurs in all women when they are older. This stage may cause several unpleasant effects that make your
-
involving both prescribed and illicit opioids are rising sharply. They’ve nearly doubled since 2009, and have infiltrated all genders, demographics and geographic areas, according to Centers for Disease Control and Prevention
-
problems are serious but others are not.⏎Age-related changes in memory⏎Forgetfulness can be a normal part of aging. As people get older, changes occur in all parts of the body, including the brain. As a result, some people may
-
implementing the tsujigahana, a 16th-century technique that produces the most obscure and jaw-dropping masterpieces. He used this technique in all of his kimono creations. When the Kubota Museum was almost bankrupt, the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the role of a teacher in the field of education, the development of new technologies, and the impact of social movements. For example, I have seen that a teacher's work might be seen as controversial, leading to debates about the legitimacy of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
CARE.)⏎In the dark all cats are gray. All persons are undistinguished till they have made a name.⏎Not room to swing a cat. Swinging
-
ont Abbey in Normandy and they established a small priory there. It only ever housed two monks however and seems to have been a simple manor house plus chapel
-
the⏎major arc AB,⏎where you go the long way around the bottom of the circle. Unless stated otherwise, it always means the⏎minor arc - the shortest of the two.⏎If
-
. The expression “Vale un potosi!” (it costs a potosi!), from Miguel de Cervantes, had finished with the reputation of the queen of the American cities. It represents the symbol of the New World and the Golden Age
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:1461 suppresses
- L5:2789 suppresses
- L5:2179 suppresses "the" after "one of"
- L6:426 suppresses
- L4:262 excites
- L4:2143 suppresses "in some" opening a qualifier
- L6:2021 excites
- L3:2187 suppresses
- L6:1363 excites
- L5:225 weakly excites
- L6:380 weakly excites
- L6:1655 weakly excites "a" or "an" after "such" or launch verbs
- L6:2112 weakly excites
- L4:661 weakly excites
- L5:2448 weakly suppresses
- L4:141 weakly excites
- L5:2519 weakly suppresses
- L6:2914 weakly suppresses
- L4:272 weakly suppresses
- L4:1995 weakly suppresses
- L6:2867 weakly excites
- L5:1830 weakly excites
- L3:1700 weakly excites
- L5:2545 weakly suppresses the zero in round numbers like 100
Feeds later layers
- L9:620 suppresses
- L12:1155 suppresses
- L16:1273 suppresses
- L12:942 excites
- L11:1517 excites
- L15:2651 excites
- L11:522 suppresses
- L15:1925 excites
- L17:2080 suppresses
- L12:491 excites
- L9:352 weakly suppresses
- L13:790 weakly suppresses
- L20:2810 weakly excites
- L13:51 weakly suppresses
- L9:918 weakly excites
- L9:543 weakly excites
- L14:380 weakly suppresses
- L9:781 weakly suppresses
- L9:334 weakly excites
- L10:633 weakly suppresses
- L11:1674 weakly suppresses
- L11:267 weakly excites
- L13:2005 weakly excites
- L8:2310 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- always
- 百分百
- тельные
- 迪
- correct
- LEGRO
- Prim
- ippers
- diaper
- always
Suppresses
- ämpfe
- ]</
- 尤为重要
- 硖
- ,</
- ircles
- 他还
- ueva
- %</
- nữa