opening year or date range
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the space right before a year or date, such as the years in a historical dating phrase. Turning it up gave wandering, unrelated text, and turning it down made the model repeat words like can't or is.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
1185 CE), Japanese art flourished, and new forms of art, such as screen painting, began to emerge. The Kamakura period (1185 CE to 1333 CE) saw the rise
-
galaxy of ours — and the galaxies beyond. And we have Copernicus, among others, to thank for that.⏎Copernicus was born in Poland in 1473 and as a young man became fascinated by math, medicine and
-
the River May (now St. John’s, Florida), in 1564. […]⏎Jacques le Moyne de Morgues (c. 1533–1588) was a French artist and member
-
He loved them very much. They always used to help one another<|endoftext|>Ramses III, Ramses also spelled Ramesses or Rameses (died 1156 bce, Thebes, Egypt), king of ancient Egypt
-
revised, January 2003, December 2006⏎Part I: The Umayyad Caliphate (661 – 750 CE)⏎5 Tibet on the Eve of the Arrival of the First
-
⏎Ink painting originated in China during the Tang dynasty (AD 618-907) and was known in Japan by the eighth
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I can't read my own record, but I can read the record of my fellow Christians. Can I do that? Can my record, as a fellow Christian, have the record of my fellow Christians? Can I hold my record as a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
06:37. Five midget submarines had been assigned to torpedo U.S. ships after the bombing started. None of these returned, and only four have since been found. Of the ten sailors aboard, nine died; the only survivor
-
24, 1896 – December 21,1940) was an Irish American Jazz Age novelist and short story writer, who is generally regarded as one of the greatest American writers of the Twentieth Century. Fitzgerald
-
eventually to be added to Olympic National Park.⏎Besides serving as postmaster, Fannie operated the store and overnight accommodations at Mora. A few of her diaries, written from 1914 to 1922, have
-
0, recounts how Radbod's son was baptised and "freed from the flesh", and died soon after. Unfortunately, no name of the son is given. Was he Fris perhaps?⏎The story of Fris reminds us of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:2618 suppresses
- L18:2893 suppresses
- L17:2799 suppresses
- L14:2753 excites
- L10:795 suppresses
- L16:1532 excites
- L20:2032 excites
- L20:1296 excites
- L12:1855 excites
- L10:781 excites
- L17:1631 excites
- L17:1767 excites
- L6:2771 excites
- L15:1138 weakly excites
- L19:1551 weakly suppresses
- L18:535 weakly suppresses
- L11:2775 weakly suppresses digits inside years like 19xx
- L18:2489 weakly suppresses
- L19:2536 weakly excites
- L13:566 weakly excites
- L21:2326 weakly suppresses
- L13:2491 weakly suppresses
- L9:508 weakly suppresses
- L20:388 weakly suppresses
Feeds later layers
- L23:535 strongly excites
- L24:60 strongly suppresses
- L24:320 strongly excites
- L27:786 strongly excites
- L25:848 strongly excites
- L23:108 strongly suppresses
- L24:252 excites
- L27:382 excites
- L24:778 excites
- L25:1841 excites
- L24:780 excites subject pronouns inside subordinate clauses
- L25:1726 excites
- L27:565 suppresses
- L25:1711 excites
- L27:1256 excites
- L24:277 suppresses
- L24:1370 excites
- L27:321 suppresses
- L23:257 excites
- L26:1716 excites
- L25:2693 weakly excites
- L24:258 weakly suppresses
- L26:1113 weakly excites
- L25:933 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Was
- was
- Was
- was
- wasn
- were
- Were
- Were
- _was
- weren
Suppresses
- can
- ister
- isters
- accounts
- cannot
- izes
- encv
- ISTER
- ustr
- will