Neuron Explorer

Qwen3-0.6B

blank slot before a number

A neuron in layer 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to an empty spot in the text where a number is about to appear, such as 'about [blank] 7.6 million people'. Turning it up or down did not produce a clear change in topic, just unrelated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    2007, cancer claimed the lives of about 7.6 million people in the world. Physicians and researchers who specialize in the

  2. #2 peak

    0 births and the risk increases with maternal age. The condition is associated with intellectual disabilities and some physical defects and most commonly heart abnormalities. The life expectancy is about 60 years. Trisomies 18 and 13 are

  3. #3 peak

    ⏎De Anza Community College, which is in the San Francisco Bay area, is one of the largest single-campus community colleges in the United States, with about 23,000 students. The student body is quite diverse, with

  4. #4 peak

    ologically advanced of the U.S. Air Force’s fighters, the F-22 Raptor created by Lockheed Martin, and the U.S. military possesses about 188 of them. At 62 feet long, with a wings

  5. #5 peak

    and the emergence into the open of the suppressed inflation.” The people would pay the price — but not until after he’d coasted to a landslide re-election in 1972 over Democratic Sen. George McGovern.⏎By the time Nixon

  6. #6 peak

    Pasadena, California.⏎Have you ever seen the Space Station pass overhead? It’s easy if you know when and where to look.⏎The Space Station orbits Earth about 15 times per day. With your unaided eyes, it looks like

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have to

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Korean is that of the etymology of the name Kudara 1. This name in Japan refers to the Korean state of Paekche⏎百濟 2, which at the time of the Three States (Samguk 三

  2. #2 peak

    . The yellow eye penguin weight up to 5 to 6kg that must be a heavy penguin.⏎Sources • 1.www.penguin.net.nz 2.book: saving the yellow eye by John Darby made in 19

  3. #3 peak

    lessons⏎Tulio Monterroso, AMUPROLOAGO: mailto:firstname.lastname@example.org; email@example.com ;⏎Cohen, S. 2

  4. #4 peak

    CCA BEEKMAN AFTERWARD THE WIFE OF GENERAL SPRY"⏎- 132.6 × 107.2 cm (52 3/16 × 42 3/16 in.)⏎-

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L16:471 suppresses blank spot before a year
  2. L17:620 suppresses
  3. L18:375 suppresses
  4. L16:363 suppresses
  5. L4:53 excites blank slot before a number
  6. L16:975 excites
  7. L15:307 suppresses
  8. L2:202 excites "of" after "many" or "which"
  9. L16:406 excites
  10. L17:402 suppresses
  11. L5:104 excites
  12. L16:0 suppresses
  13. L18:569 excites
  14. L14:59 suppresses
  15. L17:1261 suppresses
  16. L16:41 suppresses
  17. L15:539 suppresses
  18. L1:267 suppresses
  19. L0:117 suppresses
  20. L15:783 suppresses
  21. L0:258 excites
  22. L1:217 suppresses
  23. L4:31 excites
  24. L1:1256 excites

Feeds later layers

  1. L21:339 strongly suppresses spot just before a year
  2. L27:170 strongly suppresses unclear: spaces in mixed-language text
  3. L22:824 strongly suppresses blank before an expected number
  4. L23:77 strongly suppresses the space right before a number
  5. L22:424 suppresses
  6. L25:33 suppresses spot where a number is due
  7. L27:283 suppresses the spot right before a number
  8. L22:372 suppresses empty spot before a number or "3D"
  9. L26:97 excites
  10. L26:103 suppresses blank space before a number
  11. L24:938 excites
  12. L20:834 excites
  13. L23:438 excites
  14. L21:431 excites
  15. L20:111 excites
  16. L20:61 excites
  17. L26:611 excites
  18. L21:302 suppresses
  19. L20:1437 suppresses
  20. L27:306 excites
  21. L21:571 excites
  22. L27:145 suppresses dots inside web addresses
  23. L20:836 excites
  24. L21:690 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -24.97 and -24.281 values between -22.22 and -21.531 values between -21.53 and -20.842 values between -20.15 and -19.461 values between -19.46 and -18.781 values between -18.78 and -18.092 values between -17.40 and -16.711 values between -16.71 and -16.021 values between -16.02 and -15.332 values between -13.96 and -13.272 values between -13.27 and -12.581 values between -12.58 and -11.891 values between -11.20 and -10.521 values between -10.52 and -9.833 values between -9.83 and -9.141 values between -9.14 and -8.451 values between -8.45 and -7.763 values between -7.08 and -6.391 values between -6.39 and -5.701 values between -5.70 and -5.011 values between -2.95 and -2.261 values between -1.57 and -0.882733 values between -0.19 and 0.50824 values between 0.50 and 1.18290 values between 1.18 and 1.8731 values between 1.87 and 2.56offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. opt
  2. tr
  3. q
  4. im
  5. <|endoftext|>
  6. -
  7. ⏎⏎
  8. z

Suppresses

  1. parable
  2. istringstream
  3. べき
  4. wargs
  5. CCI
  6. tics
  7. hoa
  8. rams
  9. .$.
  10. iones