Neuron Explorer

Qwen3-0.6B

the digit 1 in years like 1500s

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the digit '1' at the start of a year in the 1400s or 1500s, such as 1533 or 1548. The opposite side reacts to a '2' in years like 2021. Turning it up pushed the model toward number words like 'six' and 'seven', which fits the theme of numbers.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    (95% CI, 1.4-3.0) for alcohol, 4.2 (95% CI, 3.1-5.8) for marijuana, and

  2. #2 peak

    Mary Tudor (1516-1558), Mary Stuart (1542-1587), and Elizabeth Tudor (1533-1603).⏎Knox used “monstrous

  3. #3 peak

    River May (now St. John’s, Florida), in 1564. […]⏎Jacques le Moyne de Morgues (c. 1533–1588) was a French artist and member of

  4. #4 peak

    profile, head concealed⏎Return to Photo Key to Species in Group B-2b<|endoftext|>Portrait of Katherine Parr, Queen of England (1512-1548)⏎English School, Late Sixteenth Century⏎“As the famous rhyme

  5. #5 peak

    apples, and sweets in shoes left beside beds, on windowsills, or before the hearth.⏎Colonists came to America after the Reformation in the 1500s. They were primarily Puritans and other Protestant reformers

  6. #6 peak

    of ours — and the galaxies beyond. And we have Copernicus, among others, to thank for that.⏎Copernicus was born in Poland in 1473 and as a young man became fascinated by math, medicine and science

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: six six seven six seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven seven

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    appearance of troops at Pine Ridge, he advocated for peace with the European Americans⏎Date de dernière mise à jour : 05/07/2021⏎Ajouter un commentaire<|endoftext|>By DANIEL SUDDEATH⏎NEW

  2. #2 peak

    supports other economic activity, provides an essential product and is poised for long-term growth⏎By Rob Roach, ATB Economics 22 February 202

  3. #3 peak

    stomach-churning of remedies.⏎A study published on Thursday in The New England Journal of Medicine has found transplanting human faeces into people with the superbug Clostridium difficile provided an almost universal cure for the condition - far outperform

  4. #4 peak

    ID: 4233) has a total length of 125,982 bp, and it is located in the 7q31 locus of chromosome 7. MET is transcribed into a 6,

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L21:1540 excites
  2. L21:1470 suppresses
  3. L23:1599 suppresses
  4. L23:399 excites
  5. L24:677 suppresses
  6. L23:1178 excites
  7. L21:2037 excites
  8. L22:1016 suppresses
  9. L22:452 excites
  10. L24:800 excites colon in clock times
  11. L24:909 suppresses
  12. L24:1949 excites
  13. L23:2848 excites
  14. L21:1211 suppresses
  15. L24:2493 excites
  16. L21:1011 excites
  17. L24:1627 suppresses
  18. L24:2295 suppresses
  19. L22:610 suppresses
  20. L24:1686 suppresses
  21. L22:1879 excites
  22. L23:554 suppresses
  23. L24:2113 suppresses
  24. L22:2325 suppresses

Feeds later layers

  1. L26:898 suppresses
  2. L26:580 suppresses
  3. L26:760 suppresses
  4. L26:880 suppresses
  5. L26:334 excites
  6. L27:496 suppresses
  7. L27:1100 suppresses
  8. L27:435 suppresses
  9. L27:205 excites
  10. L27:494 excites
  11. L27:785 weakly excites
  12. L27:678 weakly suppresses
  13. L26:327 weakly excites
  14. L26:522 weakly suppresses
  15. L26:739 weakly suppresses
  16. L26:1812 weakly suppresses
  17. L26:905 weakly suppresses
  18. L27:1448 weakly excites
  19. L27:391 weakly suppresses
  20. L26:957 weakly suppresses
  21. L27:132 weakly excites
  22. L27:1387 weakly excites
  23. L27:1232 weakly suppresses
  24. L27:1409 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -17.06 and -16.081 values between -16.08 and -15.094 values between -10.15 and -9.163 values between -9.16 and -8.171 values between -8.17 and -7.181 values between -7.18 and -6.205 values between -6.20 and -5.216 values between -5.21 and -4.2210 values between -4.22 and -3.236 values between -3.23 and -2.2428 values between -2.24 and -1.26580 values between -1.26 and -0.273098 values between -0.27 and 0.72103 values between 0.72 and 1.7115 values between 1.71 and 2.704 values between 2.70 and 3.6810 values between 3.68 and 4.678 values between 4.67 and 5.664 values between 5.66 and 6.651 values between 7.64 and 8.621 values between 10.60 and 11.592 values between 11.59 and 12.574 values between 12.57 and 13.563 values between 13.56 and 14.552 values between 14.55 and 15.541 values between 16.53 and 17.513 values between 17.51 and 18.501 values between 18.50 and 19.492 values between 21.47 and 22.45offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 线上线下
  2. 问他
  3. ícul
  4. reelection
  5. 给她
  6. afen
  7. 尽快
  8. 恂
  9. icion
  10. .au

Suppresses

  1. Six
  2. sixth
  3. six
  4. fifth
  5. arch
  6. Fifth
  7. Six
  8. ��
  9. Five
  10. �