comma after a finished clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires on a comma that comes after a complete statement and before an extra detail, such as 'remains somewhat unclear,' or 'Copper naturally exhibits antibacterial properties,'. Turning it up did not produce a clearly related effect in the sample outputs.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
types possess a medulla, as its presence varies among individuals and even within different hair strands of the same person. The function of the medulla remains somewhat unclear, although it is believed to contribute to the overall strength and flexibility of the hair.⏎
-
such as money lenders and payment couriers) to meet their financial needs—from receiving wages to saving money for fertilizer. However, these informal mechanisms tend to be insecure, expensive, and complicated to use. And they offer limited recourse when major problems arise
-
, 13-year-old Jared High suffered from physical injuries, depression, and possibly post-traumatic stress disorder. He committed suicide on Sept. 29, 1998.⏎Bulling isn’t a game of “child’s
-
tremendous strain on electrical systems, as seen during Texas’s deadly winter storm. Summer blackouts may become even more common, and deadlier, as temperatures soar. The energy required to save lives during these
-
that 12.4 million Californians live in census tracts with high “social vulnerability” to climate change.⏎This vulnerability can play out in various ways, says Heather Cooley, co-director of the institute’s water program and a
-
from boom to bust about 37,000 years ago. The bison population drop began well before large numbers of humans lived in the New World, and this timing suggests that climate and environmental change — not human hunting pressure — drove
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: this is a question. Let me know. So, the question is, what is the relationship between the numbers and symbols. Okay, so the question is, what is the relationship between the numbers and symbols. So, the answer is,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Bleeding-heart Gallicolumba platenae and Black-hooded Coucal Centropus steerii, and the Endangered Mindoro Hornbill Penelopides mindorensis. The Haribon
-
might not want to read about this giant new rat species which was discovered deep in the jungle of Papua New Guinea.⏎It is called the “Bosavi Woolly Rat” and was discovered during the filming of Lost Land of the Volcano,
-
, and by Nebuchadnezzar (586–573 BC) for thirteen
-
idemic” proportions. Studies show that the flu costs businesses approximately $7 billion per year due to the nearly 111 million work days lost. Norovirus cases are also on the rise this season, and the CDC reports that food
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:66 excites
- L1:86 weakly excites
- L2:284 weakly suppresses
- L1:1377 weakly suppresses placeholder example email domain
- L1:1357 weakly excites
- L1:371 weakly excites
- L2:871 weakly suppresses
- L2:126 weakly excites
- L1:1440 weakly suppresses
- L0:146 weakly suppresses
- L1:1499 weakly excites
- L0:2921 weakly suppresses
- L0:2488 weakly suppresses
- L1:2413 weakly excites
- L2:44 weakly excites
- L0:1218 weakly excites
- L0:63 weakly suppresses
- L1:1869 weakly excites
- L1:648 weakly suppresses
- L1:2556 weakly excites
- L2:771 weakly excites
- L1:1530 weakly suppresses
- L0:2830 weakly suppresses
- L2:2482 weakly suppresses
Feeds later layers
- L6:904 excites
- L22:1283 weakly suppresses
- L10:1698 weakly suppresses
- L25:23 weakly suppresses
- L6:2992 weakly suppresses
- L11:769 weakly suppresses
- L6:2724 weakly excites
- L7:1160 weakly excites
- L11:2976 weakly excites
- L24:343 weakly excites
- L14:1248 weakly excites
- L5:2910 weakly suppresses
- L15:1775 weakly suppresses
- L25:887 weakly excites
- L20:1417 weakly excites
- L19:1608 weakly excites
- L19:1310 weakly excites
- L18:11 weakly suppresses
- L14:829 weakly excites
- L4:5 weakly excites
- L5:2942 weakly excites
- L25:968 weakly suppresses
- L25:655 weakly excites
- L5:3041 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ident
- reconstruct
- redraw
- correct
- oding
- xaa
- integrate
- integrates
- ी
- ++]
Suppresses
- ()->
- 了下来
- ulary
- 了一系列
- empor
- ẢN
- laws
- ailable
- eced
- 实践活动