colon or comma before a quote
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the colon or comma at the end of a line that introduces a quotation, such as 'declared:' or 'said:' followed by a new line. Turning it up made the model produce long strings of quotation marks, which fits what it was spotting.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
8 to 21 years of age will have the chance to vote.”⏎In 1832, Noah Webster wrote in his History of the United States:⏎“When you become
-
1.26.)⏎This is comparable to Eusebius who in 325 AD wrote in Ecclesiastical History 3.27:⏎"These men, moreover, thought that it was necessary to
-
that the crustal structure doesn't follow the surface physiography,"⏎says George Zandt, a geophysicist with the University of Arizona in Tucson,⏎and lead author of the study, which appears in today's Nature.⏎"Normally
-
AIDS Programme Manager at Prague's National Institute of Public Health, says awareness is relatively high in the Czech Republic. However, he believes people are also becoming complacent:⏎"The awareness does exist, but HIV infection is underestimated by Czech citizens. It's
-
is in the left hand.⏎The next time you do the trick, use different numbers like 13 or 19.⏎- Give your friend these instructions:⏎- Think
-
-1⏎(O janamejaya) Thus, seeing the invincible wolves increasing, all the women⏎and men of vraja as a group, said:⏎sthAne neha na nah kAryaM vrajAmo
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how much power a mind铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤一面铤
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
words, it is a part of a general number that should be considered divided by 100 units. The symbol with which this fraction is represented is ” % “.⏎In this sense , saying 25
-
and is regarded as the founding pope of the Catholic church. Instrumental in the spread of early Christianity, Peter was said to have walked on water, witnessed the “Transfiguration of Jesus” and denied Jesus (for which he repented and
-
nd Para Bn's detachment were unaccounted for.⏎The mission was extremely hazardous for the members of the Simcol detachments, particularly following Hitler's infamous ‘Commando Order’ issued on 18 October 1942,
-
heart all the days of your life. And you are to make them known to your children and to your children’s children – the day you stood before the L-ord, your G-d, at Sinai” (Deuteronomy 4:
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1381 suppresses
- L24:74 suppresses
- L19:1946 suppresses
- L20:1462 excites
- L20:2332 excites
- L21:679 excites
- L22:418 suppresses
- L22:1668 excites
- L19:1409 excites
- L21:715 excites
- L21:450 suppresses
- L23:293 suppresses
- L24:618 suppresses
- L22:65 suppresses
- L20:563 excites
- L22:768 suppresses
- L22:1040 excites
- L21:1389 excites
- L20:673 excites
- L19:124 suppresses
- L20:59 suppresses
- L23:923 suppresses
- L13:44 suppresses inside web addresses and citations
- L24:1505 excites
Feeds later layers
- L27:1793 strongly excites
- L27:661 strongly suppresses
- L27:2915 excites
- L27:1277 excites
- L27:1294 excites
- L27:315 suppresses
- L27:1373 weakly excites
- L27:1197 weakly suppresses
- L27:531 weakly excites
- L27:348 weakly excites
- L27:2842 weakly suppresses
- L27:171 weakly suppresses
- L27:277 weakly excites
- L27:467 weakly excites
- L27:605 weakly suppresses
- L27:626 weakly excites
- L27:1584 weakly suppresses
- L27:2125 weakly suppresses
- L27:404 weakly excites
- L27:1474 weakly excites
- L27:2351 weakly suppresses
- L27:926 weakly suppresses
- L27:444 weakly excites
- L27:2302 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- "
- '
- "?
- ,"
- "?⏎⏎
- ,'"
- "</
- "*
- ”?
- *"
Suppresses
- '
- `
- ‘
- «
- "
- \'
- \"
- “
- ``
- Enter