'all' in 'all over the world'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'all' when it appears in phrases like 'all over the world' or 'all around Europe'. Turning it up made the model repeat 'all over the world' again and again, which matches what it responds to.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ens the knowledge of science students by taking them to places that they otherwise wouldn’t be able to go. Students can see how science affects the daily lives of people all over the world and introduces memorable case studies. These are concepts which are difficult to
-
upa in Poolesville, Maryland to the Mahabodhi Stupa in Stokes Valley, New Zealand, stupas and buddhist temples are being built all over the world.⏎The Kharma
-
At least, that’s what we thought we would be doing. Continue reading →⏎Black pepper and its flavoring companion, salt, can be found in kitchens all around the world. But did you know that black pepper is not only the world
-
has just shy of 1,000 satellites in low earth orbit that are helping to provide a connection to locations all across Canada and the Northern US. These satellites work by connecting to "earth stations
-
in quality, liked the idea of using steps and paid the inventor a small fortune to install them in his palace. Soon, steps became popular all around Europe, since France was the trend setter then. The new invention was most
-
in-person tutor can be fairly expensive, an online tutor is generally inexpensive. These tutors are located all around the world, so they are available at all times of the night or day
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if an open circuit is an error, and an error is an error? What would an error in an open circuit define as? What would an error in a circuit diagram initially be? What would an error in an electrical circuit initially be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Web: http://www.tandfonline.com/pricing/journal/VECE20|⏎When requesting a correction, please mention this item's handle: RePEc:taf:jeduce:v:42:y:20
-
epidemics of ‘fusarium ear blight’ (FEB), scientists in the UK and China have projected. Bruce Fitt from the University of Hertfordshire in Hatfield, UK, and his teammates forecast levels of the disease
-
biophysical forces in the extracellular environment may play an important role.⏎Not of Divided Mind⏎19.01.2017 | Hertie
-
15, Number 2—February 2009⏎Reemergence of Human and Animal Brucellosis, Bulgaria⏎B
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:1361 excites
- L18:598 excites
- L22:2630 weakly suppresses
- L19:1305 weakly excites unclear: verbs after a noun or 'that'
- L22:2062 weakly suppresses
- L20:762 weakly suppresses
- L23:1368 weakly excites
- L15:1014 weakly suppresses
- L20:1789 weakly suppresses
- L16:2090 weakly excites
- L22:1998 weakly suppresses
- L14:1371 weakly excites unclear: document ends and instruction verbs
- L15:822 weakly suppresses
- L18:569 weakly excites
- L20:3050 weakly suppresses
- L13:1647 weakly excites
- L16:999 weakly excites
- L3:2753 weakly excites
- L21:794 weakly suppresses
- L19:1726 weakly suppresses
- L2:2949 weakly suppresses
- L7:498 weakly excites
- L8:2328 weakly suppresses
- L20:1972 weakly excites 'of' in 'of course'
Feeds later layers
- L27:769 strongly excites
- L25:1241 strongly excites
- L26:684 excites
- L26:911 excites
- L25:596 weakly suppresses words right before 'all' or 'in'
- L26:2081 weakly excites
- L26:631 weakly excites
- L26:849 weakly excites
- L26:1970 weakly excites
- L25:1139 weakly suppresses
- L25:576 weakly suppresses
- L26:418 weakly suppresses
- L27:3026 weakly excites
- L26:1995 weakly suppresses
- L25:1437 weakly excites
- L27:1795 weakly suppresses
- L25:734 weakly suppresses
- L25:2702 weakly excites
- L26:2448 weakly suppresses
- L26:2402 weakly excites
- L25:1132 weakly excites
- L27:320 weakly excites
- L26:144 weakly excites
- L25:2607 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- all
- 所有
- all
- (all
- 所有的
- All
- All
- →all
- .all
- ALL
Suppresses
- ignant
- Winner
- 随处可见
- heets
- ですし
- 什么事情
- 万余元
- 才知道
- dyn
- iversary