Neuron Explorer

Qwen3-0.6B

unclear: spot just before a number

A neuron in layer 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron seems to switch on in the gap right before a number, like a year, a count or a figure, but the pattern is loose and not very clear. Turning it up made the text wander with no clear topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    —makes up less than one-half of 1 percent of what’s out there. Most of the universe is unseen and unidentified

  2. #2 peak

    protected by copyright law. (C) 1998-2015 Sparx Systems Pty Ltd.<|endoftext|>

  3. #3 peak

    ivut||678 - 687|⏎|Julkaisu||JOURNAL OF LANGUAGE TEACH

  4. #4 peak

    infamous misnomer celebrated by the writer Franz Kafka who described a lawyer as 'a person who writes a 10,000 word document and calls it a brief.'⏎A brief

  5. #5 peak

    Next when you are done.⏎[Update: 3/21/2009] If you are interested in setting

  6. #6 peak

    election, incumbent Clark had a 30 percentage-point lead in campaign polls, but he lost to Republican Roger J

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I need to be able to make a certain decision to be a member of the team. So I have to have to have to be a member of the team. So I need to be a member of the team. I need to be

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    2002. Pro-poor Markets for Environmental Services Carbon Sequestration and Watershed Protection. Nature Conservancy. http://biodiversityeconom ics.org/incentives/020828-01.htm

  2. #2 peak

    of analyzing. You are expected to demonstrate your ability to write a history paper and your understanding of the proper material concerning the period of history, when the World War 2 took place.⏎Before you actually start writing your essay

  3. #3 peak

    Figure 1. Note that never takes on the same value twice (any two inputs in have different outputs), whereas does take on the same value twice (both 2 and 3 have the same output, 4). In symbols, but

  4. #4 peak

    country, in every age.⏎READ ON BELOW…Don’t Sneer at Truth, Beauty and Goodness — You Were Made for Such<|endoftext|>Essay about World War 2 is quite a common deal for history classes. It helps students better understand the

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L2:2665 weakly excites
  2. L3:1902 weakly excites
  3. L0:178 weakly suppresses
  4. L0:1224 weakly suppresses
  5. L2:483 weakly suppresses
  6. L0:1301 weakly suppresses
  7. L2:1306 weakly excites
  8. L3:50 weakly excites
  9. L0:2844 weakly excites
  10. L2:75 weakly suppresses
  11. L3:2991 weakly excites
  12. L2:49 weakly suppresses
  13. L0:2963 weakly excites
  14. L0:1101 weakly suppresses
  15. L3:272 weakly excites
  16. L3:512 weakly suppresses
  17. L3:2976 weakly suppresses
  18. L0:867 weakly suppresses
  19. L0:563 weakly excites 'www' in web addresses
  20. L0:1895 weakly excites
  21. L3:1143 weakly excites
  22. L1:2444 weakly suppresses
  23. L3:157 weakly suppresses
  24. L1:1609 weakly excites

Feeds later layers

  1. L6:344 strongly suppresses
  2. L20:2907 strongly suppresses
  3. L19:981 strongly excites
  4. L5:2539 strongly excites
  5. L19:763 strongly excites
  6. L17:15 excites
  7. L16:723 excites
  8. L16:1421 suppresses
  9. L22:16 excites comma in dates and birth lines
  10. L14:309 excites
  11. L14:140 suppresses
  12. L6:42 excites
  13. L27:33 suppresses
  14. L26:21 excites
  15. L25:30 suppresses
  16. L18:76 suppresses blank spot before a number
  17. L10:177 excites
  18. L20:59 suppresses
  19. L22:14 suppresses
  20. L24:39 suppresses
  21. L18:91 suppresses
  22. L27:126 suppresses
  23. L22:424 suppresses
  24. L27:85 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -0.67 and -0.611 values between -0.56 and -0.501 values between -0.44 and -0.394 values between -0.39 and -0.3311 values between -0.33 and -0.2820 values between -0.28 and -0.2251 values between -0.22 and -0.16169 values between -0.16 and -0.11381 values between -0.11 and -0.05994 values between -0.05 and 0.011049 values between 0.01 and 0.06611 values between 0.06 and 0.12342 values between 0.12 and 0.17162 values between 0.17 and 0.2376 values between 0.23 and 0.2925 values between 0.29 and 0.345 values between 0.34 and 0.402 values between 0.40 and 0.461 values between 0.85 and 0.911 values between 1.53 and 1.58offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ex
  2. relatives
  3. sun
  4. original
  5. ban
  6. Sun
  7. ibraries
  8. contribute
  9. �
  10. out

Suppresses

  1. woke
  2. encion
  3. declar
  4. ẵ
  5. [".
  6. 发生
  7. ('_
  8. ớ
  9. ceği
  10. ída