Neuron Explorer

Qwen3-0.6B

the 1 starting a 1900s year

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the "1" that starts a year from the 1900s, such as the "1" in 1979 or 1993. Turning it up made the model's writing fill with nines, which is only loosely related.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    MBCT's main technique is based on the Mindfulness-Based Stress Reduction (MBSR) eight week program, developed by Jon Kabat-Zinn in 1979 at the

  2. #2 peak

    Day? Be like Phil the weatherman, and try some mindfulness⏎Many of us will recall the American comedy film "Groundhog Day."⏎Originally released in 1993, it stars the incomparable Bill Murray as Phil Conners,

  3. #3 peak

    chip to replace entire rooms full of computers (Fig. 1).⏎The first microprocessor was the Intel 4004 created in 1971 and was made primarily for use in calculators . By today's

  4. #4 peak

    step was to build a device to read the traffic tapes directly and eliminate the tedious manual work. The Intel 8008 microprocessor was announced in 19

  5. #5 peak

    a popular method for training neural networks. For example, one of the early papers in that area “Training Feedforward Neural Networks Using Genetic Algorithms” published in 1989, has been cited more than 1200 times.

  6. #6 peak

    youth to the violent death of Lennon's mother during his adolescence, from Lennon's post-Ed Sullivan skepticism to John and Yoko's Bed-Ins of 1969 - and unearths the secrets of its lasting import. If

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the backos, backos, backos, backos, backos, backos, backos, backos, backos, backos, backos, backos, backos, backos, backos, backos

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    about a “bomber gap” and later a “missile gap.” On October 4, 1957, Sputnik, the Soviet satellite that was the first to orbit Earth, shocked Americans and delighted the Soviets.

  2. #2 peak

    launch "gave the program a bad reputation that I don't think it really deserved," says Neufeld. "The Vanguard launch came after the success of Sputnik 1 and Sputnik 2,

  3. #3 peak

    who maintained that Germany did not join the West until after Auschwitz (1).⏎This diagnosis was reworked by the historian François Furet after the fall of the Soviet Union and the end of the cold war. Furet interpreted Nazism and

  4. #4 peak

    10.aug.25 » We have the Russians to thank for the Internet. In 1957 they won the race into space by launching Sputnik (satellite with a cool name), which remained in orbit for some

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L21:1815 excites
  2. L20:642 suppresses
  3. L23:1369 suppresses the '0' in years like 2008
  4. L18:2542 excites
  5. L2:111 suppresses
  6. L21:453 weakly excites
  7. L23:1243 weakly excites the spot right before a year's last digits
  8. L20:1954 weakly suppresses
  9. L20:1315 weakly suppresses
  10. L20:529 weakly excites
  11. L23:3058 weakly excites
  12. L16:532 weakly excites
  13. L9:1604 weakly suppresses
  14. L12:1251 weakly suppresses
  15. L20:1396 weakly excites
  16. L8:323 weakly suppresses
  17. L6:1183 weakly excites
  18. L2:75 weakly suppresses
  19. L19:1583 weakly excites
  20. L8:2018 weakly suppresses
  21. L0:1179 weakly excites
  22. L24:875 weakly suppresses
  23. L20:124 weakly excites
  24. L8:710 weakly suppresses

Feeds later layers

  1. L27:893 strongly excites
  2. L27:494 suppresses
  3. L27:1087 excites
  4. L26:2492 excites
  5. L27:628 weakly excites
  6. L26:1248 weakly suppresses
  7. L26:580 weakly suppresses
  8. L27:1519 weakly suppresses
  9. L26:528 weakly excites
  10. L26:1437 weakly excites
  11. L27:2600 weakly suppresses
  12. L26:1334 weakly excites
  13. L26:2165 weakly suppresses
  14. L27:1232 weakly suppresses
  15. L27:1268 weakly suppresses
  16. L26:1339 weakly excites
  17. L26:905 weakly excites
  18. L27:2120 weakly suppresses
  19. L26:1966 weakly excites
  20. L27:1209 weakly excites
  21. L27:1502 weakly suppresses
  22. L27:1606 weakly excites
  23. L27:2530 weakly excites
  24. L26:1158 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -24.77 and -22.251 values between -22.25 and -19.734 values between -19.73 and -17.211 values between -17.21 and -14.703 values between -14.70 and -12.189 values between -12.18 and -9.6612 values between -9.66 and -7.1422 values between -7.14 and -4.6341 values between -4.63 and -2.113299 values between -2.11 and 0.41481 values between 0.41 and 2.9313 values between 2.93 and 5.456 values between 5.45 and 7.962 values between 7.96 and 10.483 values between 10.48 and 13.001 values between 13.00 and 15.522 values between 15.52 and 18.031 values between 18.03 and 20.551 values between 20.55 and 23.071 values between 28.10 and 30.622 values between 70.90 and 73.422 values between 73.42 and 75.94offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 9
  2. 九
  3. nine
  4. 9
  5. ninety
  6. Nine
  7. 九十
  8. -nine
  9. Nine
  10. nine

Suppresses

  1. 族自治县
  2. ocities
  3. stile
  4. 膦
  5. .present
  6. 蘇
  7. atives
  8. ежду
  9. ommen
  10. 共有