and or comma closing a list
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires on the "and" or comma that joins the last item of a list or the second half of a pair, such as "(1) ... and (2) ..." or "the stem stores food and supports...". It seems to track where a list of parallel parts is about to end. The steering outputs are mostly repetitive phrases like "on the other hand", which only loosely match this.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
; (2) developing understanding of operations with rational numbers and working with expressions and linear equations; (3) solving problems involving scale drawings and informal geometric constructions, and working. K Core Curriculum - The Utah State Core Curriculum represents those standards of learning
-
). Through iterative thematic analysis we developed an alliterative “7P” model spanning 2 domains: (1) Participants (Performers and Peers); and (2) Program (Partnerships, Practicalities, and Prevention).⏎Ex
-
roots. Each of these parts does a different job. The flower is where the plant reproduces; the leaf is where photosynthesis occurs; the stem stores food and supports the rest of the plant; and the roots absorb water and nutrients from the
-
the summed products of the following 2 factors: (i) the individuals beliefs that referents (such as family and friends) influence the behavior in question; and (ii) his or her motivation to comply with these referents. Research support
-
least developed countries as regards multilateral negotiations;⏎• Formulate a sound negotiation strategy;⏎• Analyze the significance of data required for a multilateral trade negotiation; and⏎• Assess various issues that may arise during negotiation
-
7).⏎Two expressions in the quotes above catch my attention: (a) “It may be difficult for you to envision…at one time…the grand narrative” and (b) “in contemporary society…the grand narrative has
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am writing a story, which is a science fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction, fiction,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and shape of a plant, and improve flowering and fruiting. There are four basic pruning techniques used for maintaining shrubs: heading back, renewal, rejuvenation, and shearing. For information on pruning specific shrubs, download the following list
-
3 primary big game species, pronghorn antelope (Antilocapra americana), mule deer (Odocoileus hemionus), and desert bighorn sheep (Ovis canadensis mexicana). Available
-
2019. The researchers analyzed life expectancy data for the 3 largest race/ethnicity groups by state: Hispanic, non-Hispanic Black, and non-Hispanic White Americans. They found that although mean life expectancy in
-
intellectual life more effectively.⏎Charlie Kurth, assistant professor in philosophy at Washington University in St Louis, Missouri, divides anxiety into three different categories: existential, social, and moral. The first, existential anxiety, is what we experience when we think
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:2360 excites
- L15:941 excites
- L15:2440 excites word before 'and' or 'or' in pairs
- L16:2411 suppresses
- L13:557 excites
- L15:1839 excites
- L16:473 excites
- L15:3040 suppresses
- L15:132 excites
- L16:565 excites
- L15:1675 excites
- L16:2200 excites
- L15:2277 suppresses
- L16:1307 excites
- L14:449 excites
- L15:389 suppresses
- L15:2999 suppresses
- L16:1364 suppresses
- L15:1029 excites comma in three-item lists
- L15:2080 suppresses
- L15:137 suppresses
- L15:852 suppresses
- L16:2432 excites
- L16:1669 suppresses
Feeds later layers
- L19:845 strongly excites
- L19:1262 suppresses
- L18:2838 excites
- L21:344 excites
- L18:2918 excites
- L20:1083 excites
- L24:572 excites
- L20:699 excites
- L18:2862 excites
- L21:351 excites
- L18:2043 excites
- L20:82 suppresses
- L19:867 excites
- L18:957 excites
- L21:717 excites
- L20:756 excites
- L20:276 excites
- L19:164 suppresses
- L19:909 excites
- L20:328 excites
- L18:1404 excites
- L19:1092 excites
- L19:2229 excites
- L20:811 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ;',
- ;',⏎
- ;,
- .',
- ],[
- ;",⏎
- ;'⏎
- .",
- !,
- .',⏎
Suppresses
- trx
- ducible
- .hh
- hua
- tones
- bara
- easy
- istar
- 飏
- andi