"and" joining two decades or times
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the word "and" when it joins two time periods or values, like "the 1960s and 1970s". Steering did not show a clear link to this, so the effect is hard to read.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
look to the Saffir-Simpson Hurricane scale, developed as a classification system for Western Hemisphere tropical cyclones in the late 1960s and early 70s by structural engineer Herbert Saffir and his friend,
-
, who did much of her work at the Carnegie Institution, has been called a “national treasure” by the organization’s president. During the ’60s and ’70s, Rubin discovred that the stars at the outside of
-
closer to two-thirds of high school students drinking a sweetened beverage every day.⏎That's less than in the past. In the 1990s and early 2000s, more than three-quarters of teens were having
-
ferencing units to facilitate telemedicine consultations. The interactive audiovisual communications involved the rural emergency room physicians, pediatric critical-care medicine specialists at UC Davis Children’s Hospital, nurses, patients, and parents.⏎Fifty-eight consultations were conducted using telemedicine
-
began: take a look at an official government memoexternal icon informing Congress and the House of Representatives why the proposed CDC building would be essential to national defense.⏎Then and now:⏎- View a streetscape panel displayed on Roybal campus showing the original
-
1905 - 1938⏎György Nemes was a graphic artist, active during the 1920s and 1930s. He studied at Műhely, the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: and I'm a bit confused on the word "and" and "the" and "the" (and) and "the" and "the" (and) and "the" and "the" (and) and "the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
shaped by the traditions, values, and attitudes of Southerners, especially in the realms of religion, community life, family relationships, and identity. The works of art in the exhibition
-
flu and sinus infection include congestion, runny nose, fatigue and cough caused by postnasal drip.⏎Most people
-
cases of dermatitis can result in skin forming crusts or blisters which ooze fluid. There are different types of dermatitis and these are contact dermatitis, nummular dermatitis, atopic dermatitis, seborrheic
-
mudslides. Philadelphia, PA received 1.91 inches of rain.⏎A quarter of an inch of early summer snow was reported near the towns of Sharon and Hartford in the higher terrain
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:798 excites
- L6:533 suppresses
- L6:620 suppresses "and" in lists of three or more
- L5:1469 suppresses
- L6:1373 excites
- L1:2125 weakly excites
- L6:2179 weakly suppresses
- L5:426 weakly suppresses
- L0:1945 weakly suppresses
- L1:2549 weakly excites
- L6:1652 weakly excites
- L3:1131 weakly suppresses pieces inside split or hyphenated words
- L4:57 weakly suppresses
- L6:664 weakly excites
- L4:543 weakly suppresses
- L6:427 weakly suppresses
- L4:566 weakly suppresses
- L0:2657 weakly suppresses
- L5:49 weakly suppresses
- L4:2270 weakly excites
- L3:427 weakly excites
- L4:3 weakly excites commas after citation fields
- L5:539 weakly excites
- L5:2072 weakly suppresses
Feeds later layers
- L8:1046 suppresses
- L8:419 suppresses
- L10:838 suppresses comma in a list of paired nouns
- L15:677 suppresses
- L18:1413 suppresses
- L13:977 suppresses
- L8:564 suppresses
- L9:216 suppresses
- L12:1336 suppresses
- L13:125 suppresses
- L13:656 suppresses 'and' or comma between paired items
- L8:454 excites dash starting a new list item
- L15:2722 suppresses "and" or "or" in a pair or list
- L9:163 suppresses
- L9:459 suppresses
- L18:1625 suppresses
- L10:2046 excites
- L8:562 suppresses
- L9:458 suppresses
- L11:682 suppresses gap before a second number
- L9:79 suppresses
- L17:3025 suppresses
- L13:716 suppresses
- L19:1129 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ATTRIBUTE
- �
- atak
- ataka
- ATTRIBUTE
- resh
- _once
- ionale
- 怎么做
- Indented
Suppresses
- iliation
- eting
- tensions
- utor
- bamboo
- serious
- 逗
- Water
- Communications
- .toCharArray