Neuron Explorer

Qwen3-0.6B

commas inside numbers and asides

A neuron in layer 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to commas that sit in the middle of a bit of extra detail, such as a birth place after a date, or a second name in brackets, and also to the thousands comma in big numbers. It is weakest and most negative on numbers like 350,000. Turning it up or down gave text that does not clearly relate to commas.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    maintaining change that’s hard—creating new and sustained ways of thinking and behaving. As Mark Twain quipped, “Quitting [smoking] is easy, I’ve done it dozens of times.” Many can begin a positive health behavior change

  2. #2 peak

    and publish his work.⏎What makes Robert Frost unique?⏎Robert Frost, in full Robert Lee Frost, (born March 26, 1874, San Francisco, California, U.S.—died January 29,

  3. #3 peak

    the sacred isle of Columba! Here landing, he ascended the loftiest of the hills upon the isle, and "gazing into the distance, found no longer any trace

  4. #4 peak

    always used to help one another<|endoftext|>Ramses III, Ramses also spelled Ramesses or Rameses (died 1156 bce, Thebes, Egypt), king of ancient Egypt

  5. #5 peak

    is a growth hormone. So that does not help if you’re overweight, and it just becomes a vicious cycle.⏎Right. And as a former powerlifter, I often heard people say how insulin is the most powerful hormone in the human body

  6. #6 peak

    patient. There is no universal description of counterfeit drugs, but basically, it is a global phenomenon. Counterfeited drugs are dangerous not because of their counterfeit nature, but because of how they are created.⏎What are counterfeit drugs?⏎A counterfeit drug

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: If I had, I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I... I...

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    in Africa.⏎In a second report, the international team reveals previously unknown traces of a major eruption of Hecates Tholus less than 350,000 million years ago. In a depression on the volcano, researchers found

  2. #2 peak

    much of the islands and the average rainfall is in upwards of 150″ per year. Temperature varies little, with the average temperature near 82, and the humidity is always high.⏎Figure 2. Yum! After a

  3. #3 peak

    vil cells, at pressures between 938,000 and 997,000 times atmospheric pressure (

  4. #4 peak

    already signed up, you need to do it soon. Failure to do so is a felony punishable by up to five years in prison or a $250,000 fine.⏎And the system has not been updated since women were allowed

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L14:35 suppresses
  2. L9:7 excites
  3. L9:77 excites commas in citations and name lists
  4. L14:51 weakly excites colon that introduces a statement
  5. L10:2069 weakly excites
  6. L12:1557 weakly suppresses comma after an introductory phrase
  7. L14:348 weakly suppresses
  8. L9:16 weakly suppresses unclear: periods inside numbers and names
  9. L4:673 weakly excites unclear: pieces of split words
  10. L4:1266 weakly excites
  11. L14:435 weakly excites
  12. L13:78 weakly suppresses
  13. L5:5 weakly suppresses digit after a label like paper or type
  14. L13:345 weakly excites
  15. L1:226 weakly excites
  16. L4:3 weakly excites commas after citation fields
  17. L12:5 weakly excites
  18. L11:154 weakly suppresses commas after citation numbers
  19. L13:278 weakly suppresses
  20. L2:2846 weakly suppresses
  21. L2:629 weakly suppresses
  22. L10:33 weakly suppresses
  23. L3:756 weakly suppresses
  24. L10:144 weakly suppresses

Feeds later layers

  1. L16:1599 weakly excites
  2. L17:2001 weakly excites
  3. L16:2289 weakly excites 'or' linking two alternatives
  4. L19:1738 weakly excites
  5. L20:1134 weakly suppresses
  6. L25:147 weakly suppresses
  7. L16:753 weakly suppresses
  8. L16:2580 weakly suppresses 'and' linking food or health nouns
  9. L22:906 weakly excites
  10. L21:274 weakly suppresses
  11. L18:1819 weakly excites
  12. L19:806 weakly suppresses
  13. L26:1248 weakly excites
  14. L25:429 weakly suppresses
  15. L23:414 weakly suppresses
  16. L23:162 weakly excites
  17. L16:1095 weakly suppresses
  18. L24:1055 weakly excites
  19. L17:1614 weakly excites
  20. L17:2775 weakly suppresses
  21. L17:2986 weakly excites
  22. L25:1511 weakly excites
  23. L16:2614 weakly excites unclear: weak end-of-text signal
  24. L22:1669 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -9.31 and -9.021 values between -7.54 and -7.241 values between -6.95 and -6.651 values between -6.65 and -6.361 values between -5.76 and -5.472 values between -5.47 and -5.173 values between -4.88 and -4.582 values between -4.58 and -4.294 values between -3.99 and -3.695 values between -3.69 and -3.403 values between -3.40 and -3.107 values between -3.10 and -2.818 values between -2.81 and -2.518 values between -2.51 and -2.2214 values between -2.22 and -1.9221 values between -1.92 and -1.6220 values between -1.62 and -1.3332 values between -1.33 and -1.0362 values between -1.03 and -0.74113 values between -0.74 and -0.44473 values between -0.44 and -0.152529 values between -0.15 and 0.15475 values between 0.15 and 0.4567 values between 0.45 and 0.7418 values between 0.74 and 1.0415 values between 1.04 and 1.3311 values between 1.33 and 1.634 values between 1.63 and 1.924 values between 1.92 and 2.223 values between 2.22 and 2.52offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. pter
  2. ktor
  3. !';⏎
  4. VG
  5. =";⏎
  6. kv
  7. vt
  8. KV
  9. VK
  10. vn

Suppresses

  1. 我们一起
  2. 我们
  3. Dec
  4. AB
  5. Medicine
  6. ️
  7. زال
  8. ound
  9. Ặ
  10. izar