period inside an abbreviation
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop that comes at the end of a short form like 'D.C.', 'al.', 'U.S.C.' or 'Sci.' in the middle of a sentence. It does not respond to ordinary sentence endings. Turning it up or down did not give a clear, matching change in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
anomalies. Furthermore, skeptics pointed out that temperature inversions were common, but such radar sightings were not.⏎The 1952 Washington, D.C. UFO incident remains one of the most compelling in UFO history due to its duration,
-
08) is associated with marked ecological changes, including alterations to climatic regimes, phenology, resource availability and habitat quality (Zhou et al. 2004; Grimm et al. 2008).
-
car during safety tests in 2011. They grounded Boeing Co. (BA)’s newest Dreamliner airplane in January.⏎International Business Machines Corp. (IBM) plans to build a prototype next year of an alternative it calls “
-
program does not try to expunge the odd social behaviors that often make life so difficult for them. Its unconventional aim is to teach students that it is O.K. to ''act autistic'' and also how to get by in a world where it
-
more about career and technical education programs of study, talk to your counselor or career and technical education teacher.⏎Career/Technical Education can have positive impact on H.S. graduation rates⏎The chart below shows the impact taking 240 hours of
-
official seal of the CIA, however, may NOT be copied without permission as required by the CIA Act of 1949 (50 U.S.C. section 403m). Misuse of the official seal of the CIA
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about this. I have been thinking about this. I have been thinking about this. I have been thinking about this. I have been thinking about this. I have been thinking about this. I have been thinking about this
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ability to absorb calcium from the food you eat.⏎The recommended daily amounts of vitamin D are:⏎19 to 70: 600 IU<|endoftext|>Stevenson was born on Nov. 13, 1850
-
.⏎Sure, it may not be a popular as the Brooklyn Bridge when it comes to looks, but the Queensboro Bridge is iconic. Without it, Simon &- Garfunkel would not feel nearly as groovy. And just try⏎
-
of stress, like economic hardships and relationship struggles.⏎A study conducted in 2015 showed that interaction with indoor plants reduced stress as the participants felt more soothed and comfortable afterward. Caring for plants creates a serene and calming environment
-
ing to God." In other words, the noble man belongs to God, is set apart for God's use only. Proverbs 31:2- 3 -- a noble man guards his heart and sets his priorities straight.⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:493 excites
- L14:3 excites
- L14:33 suppresses
- L9:7 excites
- L14:300 suppresses
- L14:1200 excites
- L14:1100 suppresses
- L4:1097 suppresses
- L7:842 suppresses plural '(s)' after a noun
- L6:0 excites
- L13:91 excites
- L14:463 suppresses
- L9:35 excites
- L9:1515 excites line break splitting a phrase
- L9:2354 weakly excites
- L10:834 weakly excites
- L4:493 weakly excites
- L13:695 weakly excites
- L7:1123 weakly suppresses
- L14:915 weakly suppresses
- L14:730 weakly suppresses
- L10:62 weakly excites
- L5:2840 weakly excites period after abbreviation in citations
- L14:1779 weakly excites
Feeds later layers
- L16:1695 suppresses
- L16:2599 suppresses
- L16:1432 suppresses
- L18:319 suppresses
- L17:359 excites
- L18:1083 suppresses
- L16:412 suppresses
- L16:1738 suppresses
- L17:261 weakly excites
- L16:558 weakly excites
- L16:78 weakly suppresses
- L16:1095 weakly suppresses
- L20:271 weakly suppresses
- L25:199 weakly suppresses
- L16:147 weakly suppresses
- L16:306 weakly suppresses
- L16:96 weakly suppresses
- L16:2203 weakly excites
- L16:1019 weakly excites
- L24:1556 weakly excites
- L16:2831 weakly suppresses
- L17:1587 weakly excites
- L16:72 weakly suppresses
- L16:56 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- *"
- bas
- さま
- kob
- latin
- 薤
- (dec
- bé
- mex
- bicy
Suppresses
- public
- zie
- etu
- �
- äng
- iddy
- -Allow
- Mui
- scribe
- void