periods after abbreviations and initials
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the full stop that follows a short abbreviation or an initial, such as "Dr.", "Mr.", "St." or "F." in "F. Scott Fitzgerald". Turning it up did not produce any clear topic in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
-blame/failure/low self-esteem Sadness/depression: loss . In Building Self-Esteem in Children Who Are Adopted or Fostered, Dr. Sue offers simple and practical advice to those supporting children aged 7+ to help
-
, and disillusionment. Being wealthy is certainly one of the main accomplishments that characterized the American society. Through his characters, the novel The Great Gatsby by F. Scott Fitzgerald reveals the consequences of this dream on the population. The immorality
-
: pages Publisher: W. The Death and. Register a free business account Paperback: pages Publisher: W. Choose the book you like when you register 4.⏎Discussion questions for ‘The Death and Life of the Great Lakes’⏎Skip to
-
Unions Congress of Nigeria)⏎Shortly after the outbreak of the general strike in Nigeria, which started on June 21, 1945, Mr. Bankole was released from the office of President of the Trades Union Congress of Nigeria
-
' most popular cruise ship hub. Saint Thomas pampers its visitors with a wide choice of beaches, each having its own specialty. Magens Bay, St. Thomas' most visited beach, has calm waters and is ideal for swimming and children
-
and Practitioners of Medicine. By AUSTIN⏎A COURSE OF ELEMENTARY⏎PHYSIOLOGY AND HISTOLOGY. By Sir M. FOSTER, K. C. B., and J. N. L
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: 2000 A.D. C.S.4S-E-1175M-3000Y0010000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
citation below to add this definition to your bibliography:⏎"acanthosis nigricans." Definitions.net. STANDS4 LLC, 2013. Web. 23 May 2013. <http://www
-
on Flickr, CC BY-NC-SA 2.0)⏎The two Supreme Court cases, Jones v. City of Opelika 316 U.S. 584 (1942) and 319
-
is free to adopt its own laws and be ruled by them, to paraphrase the United States Supreme Court. Williams v. Lee, 358 U.S. 217 (1959).” Matthew L.M.
-
check out The Worst Foods Increasing Your Risk of Dementia.⏎Soda can age your brain.⏎A 2017 study published in Alzheimer's & Dementia found that soda was associated with accelerated brain aging and that the participants who drank at
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:614 suppresses
- L1:2683 weakly excites
- L8:505 weakly suppresses
- L4:2119 weakly suppresses
- L5:1414 weakly suppresses
- L3:567 weakly suppresses
- L6:13 weakly excites
- L3:1682 weakly excites
- L1:2922 weakly excites
- L0:612 weakly excites
- L3:685 weakly suppresses
- L6:8 weakly suppresses
- L4:2928 weakly excites
- L4:2973 weakly excites
- L2:1809 weakly suppresses
- L8:136 weakly suppresses
- L5:655 weakly suppresses
- L7:26 weakly suppresses
- L8:3005 weakly suppresses
- L6:2644 weakly excites
- L7:2209 weakly excites
- L8:1118 weakly excites
- L3:150 weakly suppresses
- L0:1709 weakly suppresses
Feeds later layers
- L12:1433 excites
- L13:1086 excites
- L10:671 excites
- L17:2961 excites
- L16:2634 excites
- L18:1105 excites
- L11:46 weakly excites
- L23:508 weakly excites
- L11:1656 weakly excites
- L16:1792 weakly excites
- L15:868 weakly excites
- L21:1132 weakly excites
- L15:286 weakly suppresses
- L16:2964 weakly excites
- L19:1308 weakly excites
- L12:2306 weakly excites
- L15:2885 weakly excites
- L21:140 weakly suppresses
- L13:1046 weakly excites 'in' or 'on' ending a phrase
- L14:150 weakly suppresses
- L25:2000 weakly excites
- L23:265 weakly suppresses
- L14:942 weakly excites
- L10:457 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- umbing
- neighbourhood
- isation
- aneously
- ise
- 而且还
- umber
- 他还
- ised
- angement
Suppresses
- crit
- lesia
- mouseup
- crire
- ơn
- zerbai
- partial
- chten
- 试验区
- applications