em dash opening an aside
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the long dash (, ) placed in the middle of a sentence to set off an extra phrase. Turning it up made the model repeat phrases like 'the same day', which does not clearly relate to the dash.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
than half of the<|endoftext|>Shin splints” is a term for a spectrum of pain in the front of the shin. The condition—very common in runners—can result from a stress injury (irritation of the bone) or a
-
). During the French Revolution (1789–99), the convent—continuously occupied and much expanded since its foundation in the thirteenth century—was closed and the nuns expelled. The convent was then sold and many of
-
series that demonstrate both the scale and specific locations of coastal change. Documentation of current delta changes—including coastal development along the Yellow River several other rapidly changing coastlines— continues from the International Space Station.⏎You can also see how the Yellow River Delta
-
home if left untreated. A dehumidifier or air conditioner can help.⏎Answer: True. Radon—a colorless, tasteless and odorless gas—seeps into homes through cracks in walls, floors and foundations. If radon
-
an observatory that can track this for years,” he said. “This allows us to use new technologies to study the how the ecology—the role of plants specifically—relates to the hydrology, the movement of water.<|endoftext|>Details of a
-
00 BCE.⏎“The occurrence of these two virulent pathogens at the end of the Early Minoan period in Crete,” they wrote in their paper, “emphasizes the necessity to re-introduce infectious diseases as an additional factor possibly
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if you have an animal that can be just like a person? what if you could use it to study and treat different sciences, but it would be a different and even better way to study and treat by just learning from it? to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
erary cult that were no longer current at the time the pyramids were built. This indicates that at least some of the Pyramid Texts can be dated to Pre-Dynastic times.⏎The texts may provide clues to the thinking behind the development
-
decreased blood⏎SETTING: Homes of participants.⏎PARTICIPANTS: 35 volunteers⏎with NIDD will be recruited by advertising on television and radio.⏎INTERVENTIONS: All participants⏎will receive education on dietary supplemention with Jerusalem art
-
8 of 101⏎It looks like you're using a mobile device. We recommend using a physical keyboard for transcription entry.⏎28 REPORT NATIONAL ADVISORY COMMITTEE FOR AERONAUTICS transverse-continued. main trans
-
account of race or color.⏎With the Civil Rights Act turning 50, the success of the struggle for equal rights for women and minorities<|endoftext|>The No Child Left Behind Act, signed into law by President Bush January 8, 20
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:563 strongly excites
- L21:418 strongly excites
- L21:959 strongly suppresses
- L19:1240 strongly suppresses
- L21:846 strongly excites
- L21:118 strongly suppresses
- L19:124 strongly suppresses
- L20:473 suppresses
- L22:65 suppresses
- L22:54 suppresses
- L20:296 suppresses
- L19:484 excites
- L21:533 excites
- L20:605 suppresses
- L20:59 suppresses
- L20:1013 excites
- L22:111 excites
- L19:68 excites full stops closing a claim
- L16:1421 suppresses
- L19:305 suppresses
- L19:2730 suppresses
- L18:91 excites
- L19:1174 excites
- L19:96 excites
Feeds later layers
- L25:557 strongly excites
- L24:328 excites
- L24:650 excites
- L26:186 excites
- L25:595 excites
- L24:483 excites
- L27:337 excites
- L26:357 excites
- L26:352 excites
- L26:553 excites
- L26:1547 excites
- L27:811 excites
- L26:788 excites
- L26:418 excites
- L27:192 excites
- L26:1426 excites
- L26:389 excites
- L26:503 excites
- L26:696 excites
- L27:561 excites
- L27:732 excites
- L27:1194 excites
- L26:465 excites
- L27:945 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ass
- ens
- im
- off
- (st
- (s
- in
- ongo
- en
- ad
Suppresses
- 薮
- Rgb
- -Jun
- uent
- ạm
- Afro
- département
- lesbian
- brisk
- libre