'Ch' starting a proper name
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the 'Ch' at the start of a word that is a place or name, such as Chomolungma or Chittenden, when the word has been split into pieces. Turning it up made the model output blank lines, and turning it down made it wander into unrelated text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Government of Nepal gave the mountain the official Nepali name. In sanskrit Sagarmatha means "mother of the universe”. The Tibetan name for Mount Everest is Chomolungma or
-
are smarter, more efficient, more earth-friendly, and which incorporate a variety of beautiful new forms not seen before in inhabited structures.⏎Our final image is of the Chesa Futura in St. Moritz, Switzerland, a futuristic ski chalet
-
25th of October, that the British cavalry were drawn up under Lord Lucan at the western end of this narrow valley directly under the steep heights of the Chersonese. On the summit, at the very edge of the heights, Lord
-
celebrated English writer.⏎Capital, Middlebury. Population, 26,549.⏎is the chief town. This county is bounded on the north by Chittenden⏎County, east by Washington and Orange Counties, and a part of
-
in them with ease.⏎There are currently 11 national parks in the Thar Desert, the largest of which are the Rann of Kutch and the Nara Desert Wildlife Sanctuaries. The Rann of Kutch is the only
-
49, Taiwan (e-mail: firstname.lastname@example.org).⏎Cite:Ming-Ju Lee, Ming-Gin Lee, Yishuo Huang, and Chia-Liang Chiang, "Purification Study of Pervious Concrete
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: there are plenty of sneraries snearing sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers sneers
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Is your person [name]?”.⏎Players are quick to understand that by asking questions that divide the candidates into two groups, such as “is your person female?”, you can reduce the candidate pool more quickly.⏎If every question halved the
-
find 386 pages of resources to learn more about Caddo history and culture, https://scholarworks.sfasu.edu/cgi/viewcontent.cgi?article=4012&context=ita⏎Visit the THC’s Learning
-
and research. Generally, these conversations can be split into two types: “Why can’t I get genetic testing?” and “What’s the point of genetic testing? It’s‘not actionable.’”⏎The American Academy of Pediatrics, along with other
-
“What is the meaning of Menstrual Hygiene Day?”, “How did it begin?”, “Why is Menstrual Hygiene Day Celebrated?”, and “How can you commemorate Menstrual Hygiene Day?”⏎Men
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1894 strongly excites
- L26:193 strongly suppresses
- L25:118 excites
- L26:130 excites ellipsis cut-off in quotes
- L2:202 suppresses "of" after "many" or "which"
- L23:474 excites
- L20:863 excites
- L16:41 excites
- L25:483 excites
- L16:47 excites
- L2:1753 excites
- L19:89 suppresses
- L0:117 excites
- L25:36 suppresses
- L14:51 excites colon that introduces a statement
- L15:123 suppresses
- L18:48 suppresses
- L26:725 excites
- L17:118 excites comma after a clause ending
- L21:173 excites
- L20:61 suppresses
- L22:271 suppresses
- L13:10 excites
- L20:8 suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ⏎
- ⏎⏎
- </
- ”
- ”⏎
- )
- ⏎ ⏎
- ⏎→→→⏎
- ⏎→→→→⏎
- )”
Suppresses
- .go
- raries
- tein
- 清醒
- criptive
- iciones
- eric
- romatic
- confisc
- /domain