Neuron Explorer

Qwen3-0.6B

"and" joining two decades or times

A neuron in layer 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

Fires on the word "and" when it joins two time periods or values, like "the 1960s and 1970s". Steering did not show a clear link to this, so the effect is hard to read.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    look to the Saffir-Simpson Hurricane scale, developed as a classification system for Western Hemisphere tropical cyclones in the late 1960s and early 70s by structural engineer Herbert Saffir and his friend,

  2. #2 peak

    , who did much of her work at the Carnegie Institution, has been called a “national treasure” by the organization’s president. During the ’60s and ’70s, Rubin discovred that the stars at the outside of

  3. #3 peak

    closer to two-thirds of high school students drinking a sweetened beverage every day.⏎That's less than in the past. In the 1990s and early 2000s, more than three-quarters of teens were having

  4. #4 peak

    ferencing units to facilitate telemedicine consultations. The interactive audiovisual communications involved the rural emergency room physicians, pediatric critical-care medicine specialists at UC Davis Children’s Hospital, nurses, patients, and parents.⏎Fifty-eight consultations were conducted using telemedicine

  5. #5 peak

    began: take a look at an official government memoexternal icon informing Congress and the House of Representatives why the proposed CDC building would be essential to national defense.⏎Then and now:⏎- View a streetscape panel displayed on Roybal campus showing the original

  6. #6 peak

    1905 - 1938⏎György Nemes was a graphic artist, active during the 1920s and 1930s. He studied at Műhely, the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: and I'm a bit confused on the word "and" and "the" and "the" (and) and "the" and "the" (and) and "the" and "the" (and) and "the

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    shaped by the traditions, values, and attitudes of Southerners, especially in the realms of religion, community life, family relationships, and identity. The works of art in the exhibition

  2. #2 peak

    flu and sinus infection include congestion, runny nose, fatigue and cough caused by postnasal drip.⏎Most people

  3. #3 peak

    cases of dermatitis can result in skin forming crusts or blisters which ooze fluid. There are different types of dermatitis and these are contact dermatitis, nummular dermatitis, atopic dermatitis, seborrheic

  4. #4 peak

    mudslides. Philadelphia, PA received 1.91 inches of rain.⏎A quarter of an inch of early summer snow was reported near the towns of Sharon and Hartford in the higher terrain

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L6:798 excites
  2. L6:533 suppresses
  3. L6:620 suppresses "and" in lists of three or more
  4. L5:1469 suppresses
  5. L6:1373 excites
  6. L1:2125 weakly excites
  7. L6:2179 weakly suppresses
  8. L5:426 weakly suppresses
  9. L0:1945 weakly suppresses
  10. L1:2549 weakly excites
  11. L6:1652 weakly excites
  12. L3:1131 weakly suppresses pieces inside split or hyphenated words
  13. L4:57 weakly suppresses
  14. L6:664 weakly excites
  15. L4:543 weakly suppresses
  16. L6:427 weakly suppresses
  17. L4:566 weakly suppresses
  18. L0:2657 weakly suppresses
  19. L5:49 weakly suppresses
  20. L4:2270 weakly excites
  21. L3:427 weakly excites
  22. L4:3 weakly excites commas after citation fields
  23. L5:539 weakly excites
  24. L5:2072 weakly suppresses

Feeds later layers

  1. L8:1046 suppresses
  2. L8:419 suppresses
  3. L10:838 suppresses comma in a list of paired nouns
  4. L15:677 suppresses
  5. L18:1413 suppresses
  6. L13:977 suppresses
  7. L8:564 suppresses
  8. L9:216 suppresses
  9. L12:1336 suppresses
  10. L13:125 suppresses
  11. L13:656 suppresses 'and' or comma between paired items
  12. L8:454 excites dash starting a new list item
  13. L15:2722 suppresses "and" or "or" in a pair or list
  14. L9:163 suppresses
  15. L9:459 suppresses
  16. L18:1625 suppresses
  17. L10:2046 excites
  18. L8:562 suppresses
  19. L9:458 suppresses
  20. L11:682 suppresses gap before a second number
  21. L9:79 suppresses
  22. L17:3025 suppresses
  23. L13:716 suppresses
  24. L19:1129 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.66 and -2.531 values between -1.53 and -1.411 values between -1.28 and -1.161 values between -1.03 and -0.911 values between -0.91 and -0.782 values between -0.78 and -0.662 values between -0.66 and -0.5312 values between -0.53 and -0.4176 values between -0.41 and -0.28419 values between -0.28 and -0.161210 values between -0.16 and -0.031446 values between -0.03 and 0.09510 values between 0.09 and 0.22108 values between 0.22 and 0.3436 values between 0.34 and 0.4722 values between 0.47 and 0.5914 values between 0.59 and 0.7212 values between 0.72 and 0.848 values between 0.84 and 0.977 values between 0.97 and 1.096 values between 1.09 and 1.222 values between 1.22 and 1.344 values between 1.34 and 1.472 values between 1.47 and 1.592 values between 1.59 and 1.721 values between 1.84 and 1.971 values between 1.97 and 2.091 values between 2.22 and 2.34offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ATTRIBUTE
  2. �
  3. atak
  4. ataka
  5. ATTRIBUTE
  6. resh
  7. _once
  8. ionale
  9. 怎么做
  10. Indented

Suppresses

  1. iliation
  2. eting
  3. tensions
  4. utor
  5. bamboo
  6. serious
  7. 逗
  8. Water
  9. Communications
  10. .toCharArray