quantifier 'all' mid-phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'all' when it comes after a verb or preposition, as in 'reuse any or all of this', 'stop all swarming' or 'clean all surfaces'. It goes quiet or flips negative on 'All' inside names and words. Turning it up made the text drift into lists and repeated numbers, which does not clearly reflect the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. Formulation of regional guidelines may help reduce AOM burden.⏎- acute otitis media⏎Statistics from Altmetric.com⏎If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance
-
swarm it is a natural process where the colonies divide. In essence, it is nature’s way of trying to increase bee colony populations. Beekeepers can not stop all swarming. However, swarm prevention should be incorporated info a beekeeper’s
-
save lives. Good communication also reduces patient anxiety, enhances patient well-being, and reduces frustration and confusion. Our focus, then, should be to improve communication across all of these vital touch points:⏎1. Between physician and patient. When our patients
-
total of ten words, all consisting of nine letters each, broken down into three equal portions, and scrambled. Each portion is used only once. Try to reconstruct all of the portions and create all ten of the nine letter words!⏎TEL ONC
-
different types of anxiety disorders. These include generalized anxiety disorder, social anxiety disorder, and separation anxiety disorder. It is possible to have more than one, or possibly all three. No matter what type(s) of anxiety you are experiencing.⏎Examples of
-
Regents made the calamitous decision to eliminate affirmative action for its then nine universities, one of the biggest public university systems in America. California’s electorate voted to end all affirmative action programs a year later.⏎Since then, Asian American efforts for equity have
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if I am a student in a school, and I have a certain amount of time from the morning, like if you have an important thing to do in the morning, like what the whole day is in the day from the morning, I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
East Java; a green fashion show in Korea; and a project aimed at developing smart grid systems in Vietnam.⏎Young leaders can make a difference⏎Siti Nur Alliah, a British Council Climate Champion from Indonesia, is tackling a burning issue in
-
ik (1898), 32; Lee, The Microtomists Vade Mecum (London, 1900); Macallum, On the Detection and Localization of Phosphorus in Animal and Vegetable Cells
-
flowers, fruit and meat from devotees to appease Siva and his consort Durga, accompanied by the rhythmic ringing of bells.⏎Young girls in saffron and white satin wraparounds, with head-dresses of coconut palm fr
-
and hypothesized that the RNA of TMV is single-stranded. This conjecture was proven to be correct after her death and is now know to<|endoftext|>Sarah Allard and Kristin Jenkins⏎Mentor: Dr. Neal Williams⏎E
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:66 excites
- L1:161 suppresses
- L16:119 excites
- L2:400 excites
- L4:308 excites
- L17:615 excites
- L15:82 suppresses
- L0:1578 excites
- L2:1803 excites
- L15:78 excites
- L16:96 excites
- L2:355 suppresses
- L17:1572 excites
- L15:114 excites
- L15:96 suppresses
- L15:80 suppresses
- L3:2187 suppresses
- L15:115 excites
- L17:517 weakly suppresses "but" in "not only X, but" phrases
- L15:89 weakly excites
- L16:14 weakly excites
- L10:2268 weakly suppresses
- L15:403 weakly excites period inside an abbreviation
- L16:95 weakly excites
Feeds later layers
- L19:574 strongly suppresses
- L21:2717 strongly suppresses
- L24:1354 weakly suppresses
- L20:1531 weakly excites
- L19:2293 weakly excites
- L20:800 weakly excites
- L19:2889 weakly excites
- L22:2274 weakly excites
- L20:3050 weakly suppresses
- L19:1788 weakly suppresses
- L19:233 weakly excites
- L24:1867 weakly excites
- L25:827 weakly excites
- L21:2472 weakly excites
- L21:1102 weakly excites 'one or more' before a count noun
- L25:572 weakly excites
- L23:2014 weakly excites
- L26:2116 weakly excites
- L26:1083 weakly excites
- L19:489 weakly excites
- L21:1840 weakly excites
- L23:2015 weakly suppresses
- L21:1306 weakly suppresses
- L23:927 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ivity
- six
- Six
- seven
- Seven
- ten
- Space
- five
- thấy
- ộc
Suppresses
- ctor
- alic
- 士
- lli
- aption
- 您的孩子
- 书香
- usion
- 慕容
- gger