comma after a publication or title name
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the comma that comes right after the name of a journal, book or magazine in a citation, such as 'Nutrients,' or 'Pediatrics,'. Turned up, the model tended to write 'vol' and 'volume' and produce citation-like lists.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
,” Gibson-Davis said.⏎CITATION: “Magic Moment? Maternal Marriage in Children Born out of Wedlock,” Christina Gibson-Davis. Demography, July 2, 2014. DOI: 10.
-
Reduction in Children and Adolescents (2011). Expert panel on integrated guidelines for cardiovascular health and risk reduction in children and adolescents: Summary report. Pediatrics, 128(S
-
, A and Burridge, CP and Austin, JJ and Jones, M, Disease induced changes in gene flow patterns among Tasmanian devil populations, Biological Conservation, 165 pp. 69-78. ISSN 0
-
as Congress reassess its budget priorities. This includes billions of dollars of tax breaks and incentives for oil and other fossil fuels.<|endoftext|>|Java: The Complete Reference, 12th Edition⏎This is Herb's most popular book on Java
-
by 2050, and that the rate of extinction is now at least 877 times the background extinction rate over geological time.⏎BioScience, published monthly, is the journal of the American Institute of Biological Sciences (AIB
-
une-system⏎- Kennedy, David O. “B Vitamins and the Brain: Mechanisms, Dose and Efficacy—A Review.” Nutrients, vol. 8, no. 2, Jan. 201
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a few friends that I have not called on the few times I should called on them. I think that's because I have a few of them on the go. Instead of thinking about them on the go and on the sleep?
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
tournament for the first time as Dutch East Indies, now Indonesia, qualified while other Asian teams withdrew.⏎The tournament saw an average of 4.66 goals per match much to the delight of the spectators across the 10 host cities.⏎
-
to cardiovascular disease, cerebrovascular disease, and cancer," stated the researchers.⏎In another study, presented at the American College of Cardiology's 68th Annual Scientific Session, it was found that people getting lower amount of calories from carbs
-
work opens the door to new biological experiments," said Thomas V. O'Halloran, the study's senior author and the Charles E. and Emma H. Morrison Professor of Chemistry in the Weinberg College of Arts and Sciences at Northwestern. He
-
loved fiercely, and disciplined that way, too.⏎This authoritative style of African American parenting is too often passed along generationally — and uncritically.⏎When Minnesota Vikings running back Adrian Peterson was indicted on allegations of child abuse, he admitted to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2469 excites
- L17:2727 excites
- L18:1014 suppresses
- L18:1922 weakly suppresses
- L16:1310 weakly excites
- L20:682 weakly excites
- L20:2462 weakly excites
- L17:3004 weakly suppresses
- L3:474 weakly excites
- L19:2883 weakly excites
- L14:154 weakly excites
- L14:1911 weakly suppresses
- L20:1109 weakly excites
- L12:2688 weakly excites
- L9:2871 weakly excites
- L17:290 weakly excites
- L10:1239 weakly suppresses
- L19:1529 weakly excites
- L15:136 weakly suppresses
- L5:372 weakly excites
- L20:916 weakly suppresses
- L9:1241 weakly excites
- L18:366 weakly excites comma inside numbers and dates
- L18:1210 weakly suppresses
Feeds later layers
- L27:2698 excites
- L22:1233 excites
- L24:795 excites
- L26:706 excites
- L26:1263 weakly excites
- L26:619 weakly excites
- L25:515 weakly excites
- L26:727 weakly excites
- L22:2172 weakly excites
- L23:2177 weakly excites
- L24:1141 weakly excites
- L23:599 weakly excites
- L24:1025 weakly excites
- L27:1103 weakly excites
- L23:1212 weakly excites
- L24:2705 weakly excites
- L27:648 weakly excites
- L23:2393 weakly excites
- L24:1175 weakly excites
- L23:1890 weakly excites
- L24:1672 weakly excites
- L26:1100 weakly excites
- L27:1018 weakly excites unclear: mixed word fragments, no shared theme
- L24:126 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- vol
- volume
- Volume
- volume
- Vol
- volumes
- Volume
- Vol
- _VOL
- Part
Suppresses
- rego
- amar
- ameleon
- üş
- -floating
- _plain
- <![
- IGHLIGHT
- óm
- <![