Neuron Explorer

Qwen3-0.6B

the zero digit in decimals

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the digit 0 when it appears in a decimal or a number that starts with a zero, such as 0.99 or 0.000001. Pushing it down made the model write long runs of zeros, and pushing it up made the writing drift into unrelated topics.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Fat, there are 0 grams of Trans Fat, and there are 5 grams left over.⏎Cholesterol - Watching your Cholesterol? One serving has 0 mg, which should make healthy eating a little easier.⏎Carbohydrates - Total

  2. #2 peak

    terrestrial (longwave) radiation, which is centered around a wavelength of 10μm. The absorptivity and emissivity around freezing point is 0.99 – meaning that only 1% of incident longwave radiation would

  3. #3 peak

    Library maintained by the Modelica Association.⏎This example demonstrates different noise distributions methods that can be selected for a Noise block. Both noise blocks use samplePeriod = 0.02 s, y_min=-1, y_max=3, and

  4. #4 peak

    . Freshwater entering the major estuaries is, where not contaminated, of acceptable quality for drinking with minimum treatment. However, iron concentrations in excess of 0.

  5. #5 peak

    A single heat pulse will switch the magnetic orientation of a nanometer-sized magnetic grain in just a few picoseconds (1 picosecond is 0.000000000001 seconds). As

  6. #6 peak

    E, 17.3 µg of Vitamin K, 106.488 g of total saturated fat, 0.216 g of lauric acid, 2.16

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately:100000000000000000000000000000000000000000000000

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    archive.jpr.org.uk/10.1177%2F13591045050537

  2. #2 peak

    ". PLoS ONE 8 (2): e57075. . . http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.

  3. #3 peak

    and%20adaptive%20immune%20system.⏎- How Vitamin C Supports a Healthy Imm

  4. #4 peak

    2017, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5707683/#:~:text=It%20is%20a%20potent%20ant

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L18:1391 strongly suppresses
  2. L20:626 excites
  3. L4:498 suppresses
  4. L17:213 suppresses
  5. L2:1795 suppresses
  6. L0:208 excites the digit zero inside codes or numbers
  7. L3:651 excites zero in dates inside URLs
  8. L19:843 suppresses
  9. L10:1052 suppresses
  10. L5:1546 suppresses
  11. L2:1463 excites
  12. L16:177 excites zero digit inside dates and codes
  13. L14:643 suppresses
  14. L18:112 suppresses 'over' meaning time or duration
  15. L9:977 suppresses the last digit of a decade year
  16. L1:45 suppresses
  17. L18:499 weakly suppresses
  18. L17:367 weakly excites
  19. L16:84 weakly excites
  20. L4:622 weakly excites
  21. L10:726 weakly suppresses
  22. L15:1991 weakly excites
  23. L22:1713 weakly suppresses
  24. L19:879 weakly excites

Feeds later layers

  1. L27:238 strongly suppresses
  2. L27:1196 suppresses
  3. L26:216 suppresses blank slot before a year or number
  4. L27:283 suppresses the spot right before a number
  5. L26:121 suppresses
  6. L27:241 excites
  7. L26:15 excites
  8. L26:103 suppresses blank space before a number
  9. L27:48 excites
  10. L27:1153 suppresses
  11. L26:413 weakly suppresses
  12. L27:1117 weakly suppresses
  13. L26:172 weakly suppresses
  14. L27:862 weakly suppresses
  15. L26:2051 weakly excites
  16. L26:1538 weakly excites
  17. L26:667 weakly suppresses
  18. L27:973 weakly excites
  19. L27:2221 weakly excites
  20. L26:957 weakly excites
  21. L27:902 weakly suppresses
  22. L27:51 weakly excites
  23. L27:1438 weakly suppresses
  24. L27:1286 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -43.94 and -41.681 values between -12.38 and -10.131 values between -10.13 and -7.882 values between -7.88 and -5.624 values between -5.62 and -3.3712 values between -3.37 and -1.113873 values between -1.11 and 1.1410 values between 1.14 and 3.401 values between 3.40 and 5.652 values between 23.68 and 25.931 values between 43.97 and 46.22offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. xb
  2. ROID
  3. xa
  4. iode
  5. roid
  6. xB
  7. Bedford
  8. aries
  9. х
  10. x

Suppresses

  1. 0
  2. 9
  3. 1
  4. 3
  5. 4
  6. 8
  7. 2
  8. 0
  9. 5
  10. 7