"of" after all three, both, ten
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "of" when it comes right after a counting word like "all three", "both" or "ten", as in "all three of these". When it was turned up, the model's writing became repetitive and didn't pick up any clear new theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
radical reforms and a long period of growth. A year later, Ronald Reagan was elected President of the United States, and also embraced free market policies. All three of these leaders professed inspiration from the work of Milton Friedman. It is natural,
-
Up until the 1950s, the Folger also housed all nine of Gregory’s plaster reliefs in storage. It wasn’t until Dr. Frederick Hard
-
you.⏎It’s easy to use a converter for all types of users. You can even gift it to your kids so that they can learn the differences between both of these numerals.<|endoftext|>ventilation, extents and position of obstacles etc., that
-
5:45 PM #1⏎FNG methods of attack question⏎I read this a couple times and I'm still confused. I was taught all three of these as interior attack methods based on fire
-
its behavior when a mechanical force is exerted on it. Rheology is distinguished from fluid dynamics (see fluid mechanics) in that it is concerned with all three of the traditional states of matter rather than only with liquids and gases. Unlike polymer physics
-
measures to ensure that the process of arbitration was carried out properly. All of 13th century Christian Europe willingly looked upon him as an international judge.⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I like of a device. The following is the information of the problem statement. So, for example, the problem of 9.2.18.2.3. In this case, the problem of 9.2.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
631–642, 2013. My thoughts precipitated a brief conversation with Erella Hovers in which, for the umpteenth time, she expounded the theory that a fossil
-
they were, literally.⏎Geographically they were as well, since they originated from at⏎least six distinct nationalities within the vast Russian Empire.⏎In every other respect, however, they were German, sharing a common⏎German culture and language.⏎
-
turmoil in a person's physical, psychological, and social health. Eating disorders most commonly affect women and occur in adolescence and young adulthood, though they can occur in anyone, of any gender, at any age.⏎Eating disorders most commonly affect women
-
growing challenge to expert knowledge and learning piloted by experts.⏎Two questions spring to mind:⏎Boundaries to schooling⏎The dissolution of boundaries in education was a hotly disputed subject. Some welcomed the dissolution as a promise of change. Others challenged its
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:1743 strongly excites
- L4:2473 strongly suppresses
- L4:285 strongly suppresses
- L1:818 excites
- L3:1249 suppresses
- L0:1824 suppresses
- L4:951 excites
- L1:518 suppresses
- L3:1456 excites
- L1:401 suppresses
- L3:1717 suppresses
- L4:731 suppresses
- L1:289 excites
- L4:52 suppresses
- L4:871 excites
- L4:137 suppresses
- L4:1032 suppresses
- L4:521 suppresses
- L4:2743 suppresses
- L1:844 suppresses
- L4:2335 suppresses
- L4:128 excites
- L4:968 suppresses
- L4:2589 excites
Feeds later layers
- L10:167 strongly excites
- L8:252 strongly suppresses 'of' after 'each' or 'one' or 'all'
- L18:602 strongly excites
- L17:985 strongly excites
- L6:84 strongly excites
- L7:173 strongly excites
- L6:1718 strongly excites
- L13:975 strongly excites
- L19:663 excites
- L8:393 excites
- L14:280 suppresses
- L21:716 excites
- L15:557 suppresses
- L7:111 excites
- L20:519 suppresses
- L11:810 suppresses
- L16:2520 excites
- L11:233 excites
- L16:715 excites
- L8:2755 excites
- L6:3016 suppresses
- L21:274 suppresses
- L6:199 excites
- L7:2164 excites period inside country abbreviations
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ものが
- two
- 时候
- 時候
- 것
- 口气
- 愿望
- ことが
- 것도
- combination
Suppresses
- lessly
- less
- ential
- ously
- ocop
- acea
- otent
- iless
- omorphic
- ABEL