comma closing a list item
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that comes right after one item in a list, just before the final 'and' or 'or', as in 'depleted resources, natural or man-made disasters'. It is quieter, and sometimes negative, on the word 'and' in 'between X and Y'. When turned up, the model got stuck repeating a sentence, so the steering is not informative.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
this product is for A SINGLE USER ONLY. That means that copying or sharing any part of this product with another teacher, grade level, school, department, district,
-
the power of your leg and core muscles.⏎There is a connection between tension headaches and stress. Conscious stretching, a healthy diet, regular exercise, and lots of sleep can lessen tension headaches.⏎Similar to how stretching in the morning
-
00<|endoftext|>The reasons and urgency that lead a group of people to just up and leave a place are varied: obsolete technology, depleted resources, natural or man-made disasters. But whatever the case, there will always be people
-
processes which ultimately result in excess cost, morbidity, readmissions, and mortality.1-4⏎There are two major types of apnea:⏎
-
give him/her a chance to correct himself/herself before being sanctioned.⏎Actions that need disciplinary action are absenteeism, poor performance, negligence, insubordination, and attendance-related issues (tardiness). In the hospitality industry, it can
-
loss. The ideal candidate for gingivitis treatment with Dr. Boulard is someone with swollen or bleeding gums, separating teeth, pain while chewing or biting, or persistent bad breath.⏎Gum disease can be caused by many things, including
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have to be able to access, and use, and then again, again, again, then, then, then, then, then, then, then, then, then, then, then, then, then, then, then
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
stratovolcano on the east coast of Sicily, close to Messina and Catania. It lies above the convergent plate margin between the African Plate and the Eurasian Plate. It is the tallest active volcano in Europe, currently standing
-
the occasional bud from a deciduous tree.⏎White-winged Crossbills are nomadic irruptive migrants, which makes their location and movements difficult to track and predict. When crops of spruce and tamarack cones are low, they
-
ocht, the famous and prestigious Eleven Towns Race that takes place in his country. For years Piet has dreamed of proving that he is a skater as brave and strong as Pim Mulier -- but he had never imagined that his test would
-
regions use their alarm calls differently to warn of approaching predators, a linguistic analysis by a team of scientists reveals. The study, which appears in the journal Linguistics and Philosophy, reveals that monkey calls have a more sophisticated structure than was commonly thought.⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:131 suppresses
- L8:593 suppresses
- L12:51 excites
- L9:212 excites
- L8:70 excites 'and' between stacked superlatives
- L12:1235 suppresses commas inside numbers and lists
- L10:688 excites
- L7:999 suppresses
- L11:682 excites gap before a second number
- L12:1246 suppresses
- L8:185 suppresses
- L10:838 excites comma in a list of paired nouns
- L11:406 suppresses
- L12:1922 suppresses sentence-ending periods in explanations
- L9:2010 suppresses
- L9:92 suppresses "and" or "or" joining two items
- L12:925 suppresses
- L12:959 excites
- L12:1095 suppresses
- L11:1253 excites
- L6:427 suppresses
- L9:159 suppresses
- L12:2071 excites
- L11:548 suppresses
Feeds later layers
- L17:2179 suppresses
- L17:335 excites
- L16:242 weakly excites
- L14:2610 weakly suppresses
- L14:2156 weakly suppresses opening parenthesis after a term
- L14:1124 weakly suppresses
- L16:2177 weakly suppresses
- L18:39 weakly excites
- L19:1006 weakly excites
- L16:511 weakly suppresses
- L19:2194 weakly suppresses first half of hyphenated compound adjectives
- L15:64 weakly excites
- L17:203 weakly suppresses
- L17:1144 weakly suppresses
- L14:1857 weakly suppresses
- L21:2707 weakly suppresses
- L20:560 weakly suppresses
- L16:1504 weakly suppresses
- L14:1475 weakly suppresses
- L20:2 weakly excites
- L16:319 weakly excites
- L16:2100 weakly suppresses
- L14:686 weakly suppresses
- L17:2353 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- .bin
- 对公司
- _clr
- .ser
- ricks
- ombat
- ertime
- : ⏎
- ерь
- rag
Suppresses
- peon
- astic
- iotic
- pliers
- 治理体系
- pe
- px
- افي
- 迫切
- anitize