closing parenthesis ending an aside
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the closing bracket that ends a side note in parentheses, such as the one after '(soccer)' or '(a kind of sugar)'. Turning it up did not produce any clear visible change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. A health care provider checks for the disorder by using techniques called amniocentesis (pronounced am-nee-oh-sen-TEE-sis) or chorionic (pronounced kawr-ee-ON-ik)
-
When your cells can’t get glucose (a kind of sugar) to burn for energy, they burn fat instead. This leaves behind acids called ket
-
and several others.They get support from so called punks and football (soccer) hooligans known as⏎"hools" to create riots and violence. From
-
. While there has been remarkable progress worldwide in giving millions of children, including girls, access to primary education, 75 million children never receive any schooling, primarily
-
LS data, women are paid 86 percent of the median hourly wages of men. This evaluation accounts for part-time (fewer than 35 hours) workers, which are more often<|endoftext|>Hiding information in an executable⏎Often times
-
of paramount importance to avoid that induced abortion technology seeps into every field of Medicine.<|endoftext|>(Photo by Ginger Holser.)⏎Beavers (Castor canadensis) are the largest living rodents in North America, with adults averaging 40 pounds
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: A. (A) (B) (C) (D) (A) (B) (C) (D) (A) (B) (C) (D) (A) (B) (C) (
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, we used transcranial magnetic stimulation (TMS) to disrupt neural activity in the RTPJ transiently before moral judgment (experiment 1, offline stimulation) and during moral judgment (experiment 2, online stimulation). In both experiments,
-
9-10 percent.⏎The Confederate legislature had passed a law empowering women to work in army hospitals – a move that freed up male medical personnel for battlefield service – but Pember’s presence as “matron” of one of the hospital’s
-
50V.⏎This<|endoftext|>Warning: Use of undefined constant user_level - assumed 'user_level' (this will throw an Error in a future version of PHP) in /home/commons/public_html/wp-content/plugins/ultimate-google-analytics/ultimate_g
-
very well reading books, but have you ever considered that you will never get a sense of shape and size…what about the feel and smell? (Wikipedia) is just the world’s interpretation of history. In a museum or past site it
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:1195 excites closing bracket ending an aside
- L3:153 suppresses
- L11:547 weakly excites
- L8:926 weakly suppresses
- L8:2208 weakly excites
- L6:2232 weakly suppresses
- L13:771 weakly suppresses
- L6:1654 weakly excites
- L3:260 weakly excites closing bracket after an acronym
- L6:655 weakly suppresses
- L7:1191 weakly suppresses
- L6:1006 weakly suppresses
- L2:2373 weakly suppresses
- L9:1802 weakly excites
- L13:1422 weakly suppresses
- L10:791 weakly suppresses
- L7:551 weakly suppresses
- L11:112 weakly excites
- L4:91 weakly excites
- L8:101 weakly excites unclear: commas and 'or' in lists
- L3:2055 weakly suppresses
- L4:83 weakly excites
- L8:230 weakly excites
- L8:1211 weakly excites
Feeds later layers
- L17:1167 excites
- L16:1369 excites
- L23:530 weakly excites
- L17:69 weakly suppresses
- L16:2491 weakly excites
- L17:2157 weakly suppresses
- L16:611 weakly excites
- L17:1253 weakly suppresses
- L16:2042 weakly excites
- L25:334 weakly suppresses
- L16:1155 weakly excites
- L17:1824 weakly suppresses
- L20:168 weakly suppresses
- L16:1112 weakly suppresses
- L21:214 weakly suppresses
- L17:293 weakly suppresses
- L22:251 weakly excites
- L17:534 weakly suppresses comma before a list continues
- L17:1241 weakly excites
- L23:1236 weakly excites
- L17:599 weakly excites
- L16:391 weakly suppresses
- L16:1578 weakly excites
- L25:1457 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 报记者
- himself
- paced
- acker
- uada
- 轻
- simplicity
- WSC
- duced
- -pr
Suppresses
- elif
- SHALL
- →elif
- 人均
- гля
- irth
- ellen
- else
- elif
- 并将