period inside country abbreviations
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop inside abbreviations such as 'U.S.', 'U.K.' and 'U.S.C.', where the dot is part of a name and not the end of a sentence. Turning it up did not produce any clear theme in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
cited statute is Section 1185 of Title 23 of the Vermont Statutes Annotated. And the federal citation 42 U.S.C. § 1395 tells us that this cited federal statute can be found
-
official seal of the CIA, however, may NOT be copied without permission as required by the CIA Act of 1949 (50 U.S.C. section 403m). Misuse of the official seal of the CIA
-
Wednesday.⏎The legal case comes after last week when climate advisors in the U.K. warned that the younger generation will be the ones paying the price of climate change.
-
sunscreen are more likely to experience painful, damaging sunburns, a new study shows.⏎The study, the first to look at how people in the U.S. shield themselves from the sun and how well those different strategies work, analyzed information on
-
their students. Texas, Michigan, Idaho, Illinois and Virginia also set a low bar.⏎Standards still declined in rigor in 26 states and D.C. between 2009 and 2011, while 2
-
to 70 mph at Austin, TX, and gusts to 75 mph at Tulsa, OK.⏎Many cities in the central and eastern U.S. reported record high temperatures for the date. Highs of 100°
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: problems. The 2010 problems. Unselected. Triangles. Triangles. Numbers. Triangles. Numbers. L. V. Tri. Numbers. L. V. Tri. Numbers. L. V. Numbers.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
reproduced in⏎Rice: Amber the Golden Gem of the Ages, the Polish Academy of Sciences:⏎Amber in Nature, a German⏎publication: Lausitzer Bernstein, and Grimaldi:⏎Amber Window to the Past.⏎Mark Meyer
-
ldesammlungen, Munich, Germany|⏎|Credit||Courtesy of Bildarchiv Preussischer Kulturbesitz/Art Resource, NY|⏎|Larry SilverProfessor of
-
cause of one of the botanical mysteries of the Burren as the Dense Flowered Orchid is native of the Mediterranean yet here growing alongside the (Alpine) Gentian and often with Mountain
-
in large quantities. Ceylon (Sri Lankan) cinnamon has lower levels of coumarin.⏎A study by researcher J.H.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:1747 suppresses
- L5:125 excites "of" after all three, both, ten
- L6:1718 suppresses
- L6:3044 suppresses
- L4:2743 excites
- L4:2335 excites
- L6:972 excites "well" after "how"
- L6:479 excites
- L6:1789 suppresses
- L6:3016 suppresses
- L5:1372 excites
- L6:199 excites
- L4:212 excites
- L5:1788 suppresses
- L6:1540 excites
- L6:181 weakly excites periods in abbreviations and the 's in names
- L4:285 weakly excites
- L2:1126 weakly suppresses
- L1:818 weakly suppresses
- L4:951 weakly suppresses
- L4:19 weakly suppresses
- L1:682 weakly excites
- L1:761 weakly excites
- L4:2473 weakly excites
Feeds later layers
- L10:167 strongly suppresses
- L8:252 excites 'of' after 'each' or 'one' or 'all'
- L17:985 suppresses
- L15:557 excites
- L11:810 excites
- L18:602 suppresses
- L13:975 suppresses
- L19:663 suppresses
- L21:274 excites
- L13:527 suppresses
- L20:337 excites
- L13:641 suppresses
- L17:1027 suppresses
- L14:2271 excites
- L9:240 suppresses
- L8:2755 suppresses
- L9:152 suppresses
- L21:68 excites
- L18:277 excites
- L12:372 suppresses
- L8:393 suppresses
- L16:2520 suppresses
- L9:434 suppresses comma after an adjective in a list
- L8:2095 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- lessness
- less
- weeney
- 峨
- .blit
- ฆ
- erne
- 拜师学艺
- -less
- 蚓
Suppresses
- 时候
- ことが
- älle
- transformations
- appen
- /**<
- ことに
- recurring
- oor
- validators