period after abbreviations
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop that follows a short abbreviation, such as 'Aug.', 'Dec.', 'Lt.' or 'P.O.'. It is not clearly tied to a theme in the steered text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Federal Death Penalty" Washington Law Review (2010).<|endoftext|>Last updated 2/27/15⏎Isothermal Community College⏎P.O. Box 804, Spindale NC 28160
-
ID also called on Chile to speed up its judicial process and create a national plan to search for disappeared persons.⏎From Jurist, Aug. 23. Used with permission.<|endoftext|>Oise River, river that rises
-
as a result of the way we eat. Industrial food production pollutes rivers and streams, creating massive offshore dead zones. It kills off bee colonies, consigns millions of animals to inhumane confinement, and disrupts the climate.⏎True
-
awareness and tolerance about race in a very interesting way. West Chicago High School’s Glee Club will hold a “Charity Minstrel Show” on Dec. 21.⏎According to the show’s press releases, “
-
the 26th were assigned to Brigadier General J. B. Plummer's Brigade on February 19, 1862. Lt. Col. Tinkham and the 26th Illinois Volunteers engaged Confederate troops
-
ξικογράφος lexikographos, "lexicographer", from λεξικόν lexicon, neut. of λεξικός lexikos, "of or for
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have to be specific in my answer, and I have to be specific about my answers in the form of numbers. So I have to be specific about the numbers, and that I have to be specific about the numbers in the context of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
In such cases, it becomes really important to use proper protective equipment in order to save yourself from an electric shock that may end up either injuring you too badly or worse.⏎Therefore, wearing shock
-
position, such as rolling over or getting out of bed, gives you a sudden spinning sensation. What’s happening is that tiny crystals in your inner ear become dislodged and shift out of place, which causes the sensation of vertigo. The
-
The tendency to be passive when action is required⏎* Feelings of frustration⏎* Feelings of incompetence⏎* Feelings of loneliness⏎* Feeling of powerlessness⏎* Believing that things will turn out bad no matter what action is taken
-
, but he does believe it could be affordable if they are prepared to make strip till their only system for row crops. “It’s not affordable if strip tillage is adopted from the standpoint of being yet another tillage option for that farm,”
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:33 strongly suppresses
- L6:182 suppresses
- L13:695 excites
- L9:39 suppresses
- L6:248 excites
- L14:6 suppresses
- L8:592 excites
- L14:921 excites
- L5:2171 excites
- L9:2308 weakly suppresses
- L12:126 weakly suppresses
- L5:365 weakly excites
- L6:949 weakly excites
- L9:94 weakly suppresses
- L14:418 weakly excites
- L4:522 weakly excites
- L2:1339 weakly suppresses
- L10:77 weakly suppresses
- L14:2 weakly suppresses
- L4:250 weakly excites
- L8:1341 weakly excites
- L3:15 weakly excites
- L14:15 weakly suppresses
- L9:2577 weakly excites
Feeds later layers
- L16:2249 suppresses
- L16:450 excites
- L16:480 excites
- L17:469 excites
- L19:224 suppresses
- L16:847 excites
- L18:543 weakly suppresses
- L17:1904 weakly suppresses
- L20:494 weakly suppresses
- L16:665 weakly excites
- L16:413 weakly excites
- L16:1293 weakly suppresses
- L23:598 weakly suppresses
- L16:627 weakly suppresses
- L16:969 weakly suppresses
- L17:566 weakly suppresses
- L21:1461 weakly excites
- L18:124 weakly excites
- L18:2307 weakly excites
- L25:2212 weakly suppresses
- L18:1283 weakly excites
- L17:2252 weakly excites
- L24:2311 weakly suppresses
- L16:2770 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ussed
- ially
- weise
- ly
- like
- way
- or
- pletely
- ter
- ately
Suppresses
- 资产评估
- 骢
- sanitizer
- hä
- Ferry
- 雇佣
- ; ⏎ ⏎
- lemetry
- ;t
- Enforcement