commas inside lists of nouns
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on commas and dashes that separate items in a list of nouns, like 'resources, natural disasters' or bullet points of symptoms. It is quiet or negative inside medical symptom lists. Turning it up gave text that did not clearly follow the list idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
00<|endoftext|>The reasons and urgency that lead a group of people to just up and leave a place are varied: obsolete technology, depleted resources, natural or man-made disasters. But whatever the case, there will always be people
-
ised in sociology to spell out the prevailing patterns of behavior and belief among members of your society or community, including these kinds of factors seeing that language, religious beliefs, relatives practices, monetary systems, and belief and value systems.⏎Internet dating Culture:
-
only need the services of a general dentist, there are many other issues that require specialist services. An endodontist provides treatment for:⏎- Chipped teeth⏎- Broken teeth⏎- Infected teeth⏎- Cracked teeth⏎- Infl
-
of distinct characteristics that this map aspires to signify. There are several forms of maps that attempt to symbolize particular things. Maps can display political borders, inhabitants, bodily characteristics, all-natural solutions, highways, environments, height (topography
-
under control so you can react to river hazards, obstacles and other boats.⏎Know and be aware of river signs, both natural and man-made, such as holes, wrap rocks, under cuts, rock sieves, horizon lines across the river --
-
1 percent in Hispanics).These racial/ethnic differences in the use of smoking cessation remained significant even after controlling for various other factors (for example, health insurance coverage, or socio-economics status of smokers).⏎“The good news is the number of smokers
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's been a while since I've had a chance to read it? Or maybe not? Or not? Maybe not? Maybe not? Or not? Or not? Maybe not? Maybe not? Or not? Maybe not? Maybe not
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
starts.⏎Stroke signs and symptoms include:⏎Trouble talking and understanding what others are saying. You may get upset, talk blurred or have trouble understanding speech.⏎Paralysis or numbness of the face, arm, or leg may occur. You may
-
is a slowly progressing, degenerative disease that is usually associated with the following symptoms, all of which result from the loss of dopamine-producing brain cells:⏎- tremor or trembling of the arms, jaw,
-
signs or symptoms of strep throat, see your doctor for prompt testing and treatment.⏎Signs and symptoms of strep throat can include:⏎- Throat pain that usually comes on quickly⏎- Painful swallowing⏎- Red and swollen tonsils
-
with the Zero Waste Concept⏎Adapt to the 3 R’s of Waste Hierarchy⏎The 3 R’s of the waste hierarchy are,⏎- Reduce – It best to reduce and minimize buying unnecessary items.⏎- Reuse – Consider re
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1756 excites
- L12:365 suppresses
- L12:1252 suppresses
- L12:690 excites
- L12:2071 excites
- L12:990 suppresses
- L12:314 excites
- L12:2600 excites
- L12:660 excites
- L12:94 excites
- L12:355 excites
- L12:2957 excites
- L12:2066 excites
- L12:152 excites
- L12:2204 suppresses
- L8:986 suppresses
- L10:122 excites
- L11:729 excites
- L11:1251 excites
- L12:1379 weakly excites
- L12:2286 weakly excites
- L12:1945 weakly suppresses
- L12:2981 weakly suppresses
- L12:185 weakly suppresses
Feeds later layers
- L17:518 excites
- L16:2251 suppresses
- L19:1820 suppresses
- L18:2118 suppresses
- L16:1572 suppresses
- L17:84 suppresses
- L17:1117 excites
- L17:997 weakly suppresses
- L16:300 weakly excites commas inside lists of nouns
- L16:1427 weakly excites
- L18:101 weakly suppresses
- L14:1082 weakly suppresses
- L22:368 weakly excites
- L15:1798 weakly suppresses
- L18:2078 weakly excites
- L17:173 weakly suppresses opening bracket that adds a synonym
- L14:1386 weakly suppresses
- L16:1977 weakly suppresses
- L15:1064 weakly excites
- L20:277 weakly suppresses
- L14:1321 weakly suppresses
- L15:2314 weakly excites
- L21:76 weakly suppresses
- L18:2021 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ':⏎
- ']):⏎
- ': ⏎
- 摊
- ':⏎⏎
- mond
- __':⏎
- __('
- _='
- ']:⏎
Suppresses
- бо
- yper
- */,
- porta
- enan
- plib
- 或将
- »,
- }`,
- бор