commas inside lists of names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that comes right after one item in a list, such as a list of places, names, or things, before the next item follows. Turning it up did not produce a clear change in topic or style.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the First Nation of Na-Cho Nyak Dun, the Tetlit Gwich’in Council, Tr’ondëk Hwëch’in, and the Vuntut Gwitchin First Nation, hold traditional territories in the
-
published in Journal of the American Chemical Society and can be read online.<|endoftext|>Reproductive prints—copies specifically made to replicate drawings or paintings—were collected, studied, and enjoyed widely in the eighteenth century. Interest in collecting reproductive prints stimulated new
-
very motivation for departing the Union was their objection to federal authority. On February 4, 1861, representatives from the seven states Alabama, Florida, Georgia, Louisiana, Mississippi, South Carolina, and Texas-that had already seced
-
ponder what kind of evolutionary changes might occur due to the impact of climate change.⏎Thanks to our Patrons Cristina Magistrali, Toren Wallengren, Eric Huffman, Julia Casey, Colton Siefker, Daniel Wenger, Mat
-
Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in
-
. To guarantee Southerners their much-desired states' rights, the federal government had no authority to levy protective tariffs, make internal improvements, or overrule state court decisions, while states had the right to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I should do this, so I do, and I have, I will, and I will do, and I will do something, and I will do this, and I will do something, and I will do something, and I will
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
agency that works with youth and that has a mission of supporting early, preventative substance abuse.⏎This curriculum is intended to be facilitated by a health or science teacher, mental health worker, law enforcement officer, or other youth services provider in a school or
-
confidential information in response to an unsolicited e-mail, text message or phone call, no matter who the source supposedly is.⏎3. Don
-
2023 by officers from Thailand’s Natural Resources and Environmental Crime Division highlighted ongoing concerns about the illegal macaque market in the Mekong region, heightened worries about the possibility of another pandemic
-
. (This also happens to be the opinion of the FDA, public health officials, and most dietitians and doctors). Raw – aka unpaste
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:1605 strongly excites
- L5:3012 suppresses
- L8:250 suppresses
- L5:675 excites
- L2:1154 suppresses
- L7:270 suppresses
- L8:1238 suppresses
- L3:487 suppresses
- L3:758 excites
- L7:403 excites
- L2:66 excites
- L6:1230 excites
- L9:92 excites "and" or "or" joining two items
- L9:77 excites commas in citations and name lists
- L5:49 suppresses
- L6:620 suppresses "and" in lists of three or more
- L7:65 excites
- L5:548 suppresses
- L3:392 suppresses
- L3:389 suppresses
- L9:2302 suppresses
- L7:257 weakly excites
- L3:661 weakly excites
- L5:51 weakly suppresses
Feeds later layers
- L13:1066 strongly suppresses
- L15:1839 strongly suppresses
- L14:1746 strongly suppresses
- L13:1296 strongly suppresses
- L16:2432 strongly suppresses
- L16:2577 suppresses
- L17:2221 suppresses
- L12:1235 suppresses commas inside numbers and lists
- L11:876 excites 'other' after 'among' in lists
- L15:2277 excites
- L14:1116 excites 'and' inside lists
- L16:1145 suppresses commas inside short lists
- L12:501 suppresses
- L15:1213 suppresses
- L13:926 suppresses
- L19:1369 suppresses
- L17:919 suppresses
- L13:557 excites
- L19:2416 suppresses
- L13:497 excites
- L18:1394 suppresses
- L14:816 suppresses
- L16:1766 suppresses
- L12:1756 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- """)⏎
- '''⏎
- elic
- .exceptions
- 。「
- ogg
- economic
- '''
- geb
- '''⏎
Suppresses
- anda
- ryo
- etc
- arie
- olta
- 让您
- warts
- าม
- afen
- raining