Neuron Explorer

Qwen3-0.6B

the last zero in large numbers

A neuron in layer 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to a zero that finishes a big number, such as the last 0 in 4,000 or 8000. It is a number-shape detector rather than a topic detector. Turning it up gave text with no clear link to numbers.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    number must be lower than the safe working load of the wheel you intend to use.⏎For example, a 4,000-lb cart with 4 wheels required to carry a 6,00

  2. #2 peak

    tars and waxes that stifle the process.⏎However, it turns out that these tars and waxes are no match for an 8000K (7,727°C) plasma arc which, through a combination

  3. #3 peak

    , Laundry, hostel and canteen effluent waste. The above waste is treated through Pond setup in the institute with a capacity of 24000 KLD (Kilo Liters per Day). The entire treated water is used

  4. #4 peak

    5000 copies and never went out of print.⏎This PDF is a full-text searchable reproduction

  5. #5 peak

    are 610 mg of Sodium in this food.⏎Vitamins - This food has both Vitamin A and Vitamin C. One serving contains 500 International Units of Vitamin A and 1.2 mg of Vitamin C.<|endoftext|>

  6. #6 peak

    sugar and fatty snacks.⏎People’s energy needs vary depending on age and activity levels but usually men require more energy than women. Men need about 2500 kcals and women about 2000 kcals per day.⏎Break

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: what is the use of the word "fear" in the sentence? What do you think? I see that it is important, and I know that the word "fear" is an example of the use of the word "f

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    the growth of two human embryonic stem cell lines that lack PIG-A, and therefore do not contain any proteins known as glycosylphosphatidylinositol (GPI) anchor proteins on the cell’s surface. GPI anchor

  2. #2 peak

    We found that, across the western Palaearctic, urban blackbird populations contain less genetic diversity than rural ones, urban populations

  3. #3 peak

    ⏎Semiarid and desert climates occur in regions with little precipitation. Desert climates are drier than semiarid climates. Semiarid climates, also called steppe climates, usually border

  4. #4 peak

    whose electrochemistry makes carbon capture appear nearly effortless. Their invention is a kind of battery: conductive electrodes coated with a compound called polyanthraquinone, which has a natural chemical attraction<|endoftext|>From: Michael Bar

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L3:1169 suppresses
  2. L3:494 suppresses
  3. L5:807 excites
  4. L5:138 suppresses
  5. L4:2830 excites
  6. L4:1158 weakly suppresses
  7. L6:7 weakly suppresses
  8. L5:158 weakly suppresses
  9. L4:2996 weakly suppresses
  10. L2:1607 weakly suppresses
  11. L6:513 weakly excites
  12. L6:13 weakly excites
  13. L1:2683 weakly excites
  14. L4:1088 weakly suppresses
  15. L4:1351 weakly suppresses
  16. L5:110 weakly suppresses
  17. L5:1336 weakly suppresses
  18. L5:2257 weakly suppresses
  19. L1:189 weakly suppresses
  20. L1:1365 weakly suppresses
  21. L5:1047 weakly excites
  22. L6:611 weakly excites
  23. L6:58 weakly excites
  24. L6:2300 weakly suppresses

Feeds later layers

  1. L17:106 strongly suppresses
  2. L16:75 strongly suppresses
  3. L19:2417 suppresses
  4. L20:121 suppresses
  5. L17:278 suppresses 'as' in 'as well as' and 'as much as'
  6. L20:174 suppresses
  7. L16:628 suppresses
  8. L18:102 suppresses
  9. L19:569 suppresses
  10. L21:381 suppresses zeros inside long number codes
  11. L18:205 suppresses
  12. L21:1072 weakly suppresses
  13. L20:413 weakly suppresses
  14. L26:875 weakly excites
  15. L17:594 weakly suppresses
  16. L19:311 weakly excites
  17. L19:906 weakly suppresses
  18. L18:139 weakly suppresses
  19. L24:1723 weakly suppresses
  20. L23:1756 weakly suppresses
  21. L17:886 weakly excites
  22. L26:1902 weakly suppresses
  23. L11:2856 weakly excites
  24. L27:1991 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.65 and -0.573 values between -0.57 and -0.509 values between -0.50 and -0.4232 values between -0.42 and -0.3572 values between -0.35 and -0.28180 values between -0.28 and -0.20369 values between -0.20 and -0.13674 values between -0.13 and -0.05882 values between -0.05 and 0.02808 values between 0.02 and 0.10478 values between 0.10 and 0.17249 values between 0.17 and 0.2593 values between 0.25 and 0.3234 values between 0.32 and 0.3915 values between 0.39 and 0.471 values between 0.47 and 0.541 values between 0.54 and 0.621 values between 0.69 and 0.771 values between 0.77 and 0.841 values between 0.84 and 0.911 values between 1.21 and 1.281 values between 1.28 and 1.361 values between 1.58 and 1.661 values between 2.25 and 2.32offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ------------
  2. ever
  3. 醮
  4. ева
  5. edException
  6. ulaire
  7. turb
  8. ------------⏎
  9. ings
  10. kat

Suppresses

  1. gore
  2. SetBranch
  3. Search
  4. Jag
  5. 庆
  6. 锯
  7. Jong
  8. _SEARCH
  9. แนะ
  10. -guid