Neuron Explorer

Qwen3-0.6B

the digit 1 starting a year

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the digit 1 at the start of a year, like the 1 in 1896, 1848 or 1874. Turning it up made the writing wander into unrelated topics, so the effect on the text is not clear.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    contrast to chemical pesticides – have no adverse effects on animals or humans.<|endoftext|>F. Scott Fitzgerald⏎Francis Scott Key Fitzgerald (September 24, 1896 – December 21,1940) was an

  2. #2 peak

    , early 20th century.⏎© Science Museum / Science & Society Picture Library⏎This wall telephone uses the chalk receiver invented by Thomas Alva Edison (1847-1931) in 1878.

  3. #3 peak

    location.⏎Like much of California, Sacramento’s railroad shops grew quickly.⏎Just 14 years after gold was discovered at Sutter’s Mill in 1848 and only a dozen years after the state was admitted to the Union

  4. #4 peak

    pertinent and weighty, it cannot be too extended.⏎Eccl. Law. The name of a kind of papal rescript.<|endoftext|>Edward Hopper (1882-1967).⏎His enigmatic depictions of America

  5. #5 peak

    comma and a death. Numerous authors of that era wrote gruesome tales about being buried alive. Among them were Edgar Allen Poe who published The Premature Burial (1844), The Cask of Amontillado (184

  6. #6 peak

    of many who thought of themselves as “progressives.” It appeared in western Europe and then spread to the United States, becoming especially evident in the Progressive Era (1890 to 1

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: The right to right now being right now, so right now being right now, right now being right now, right now being right now, right now being right now, right now being right now, right now being right now, right now

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    record we have of the military conflict is the myth of the wars between the supernatural guardians of the different peoples. Such a myth is that of the wars between the Hellenic gods and the Titans and giants, and the celestial usurpation by

  2. #2 peak

    sephone. No one, god nor mortal, has the courage to tell her what happened. Finally, through information gleaned by the pre-Olympian goddess Hecate, Dem<|endoftext|>English Grammar and Social Class⏎With grammar, as with

  3. #3 peak

    after a Greek original from the 4th century BC. ( Public Domain )⏎The famous Hymn then begins with the reciting of Zeus’ agreement with Hades in regards to Persephone. To be sure, his being an absentee

  4. #4 peak

    throughout theworld." (LXXXI.3)The moon will either be outright destroyed or permanently hidden, for we are told that it will be eaten by Hati Managarm, and the sun will be spattered by its blood.

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L22:1086 excites
  2. L21:3013 suppresses
  3. L24:909 weakly excites
  4. L12:1007 weakly excites
  5. L18:344 weakly suppresses
  6. L13:383 weakly excites
  7. L20:1902 weakly excites
  8. L23:2895 weakly suppresses
  9. L23:2441 weakly excites
  10. L22:1694 weakly excites
  11. L15:1096 weakly excites
  12. L22:1203 weakly suppresses
  13. L14:95 weakly excites
  14. L21:1667 weakly excites
  15. L17:241 weakly excites
  16. L1:1441 weakly suppresses
  17. L4:2091 weakly excites
  18. L2:1317 weakly excites
  19. L3:244 weakly suppresses
  20. L0:952 weakly suppresses
  21. L17:28 weakly excites
  22. L0:2177 weakly excites
  23. L21:593 weakly excites
  24. L3:1552 weakly excites

Feeds later layers

  1. L26:976 strongly excites the '1' starting a century
  2. L27:763 excites
  3. L27:785 suppresses
  4. L26:580 suppresses
  5. L27:496 weakly suppresses
  6. L26:898 weakly suppresses
  7. L27:1389 weakly excites
  8. L26:977 weakly excites
  9. L26:1823 weakly suppresses
  10. L27:1213 weakly excites
  11. L27:1500 weakly suppresses
  12. L27:678 weakly suppresses
  13. L26:739 weakly suppresses
  14. L27:2715 weakly suppresses
  15. L27:1842 weakly suppresses
  16. L26:658 weakly suppresses
  17. L26:2180 weakly suppresses
  18. L26:882 weakly excites
  19. L27:1646 weakly suppresses
  20. L27:1968 weakly excites
  21. L26:1484 weakly suppresses
  22. L26:2666 weakly suppresses
  23. L26:2008 weakly excites
  24. L26:1023 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -14.80 and -12.531 values between -7.98 and -5.713 values between -5.71 and -3.4418 values between -3.44 and -1.173838 values between -1.17 and 1.1024 values between 1.10 and 3.386 values between 3.38 and 5.653 values between 5.65 and 7.924 values between 7.92 and 10.192 values between 10.19 and 12.462 values between 12.46 and 14.731 values between 14.73 and 17.001 values between 17.00 and 19.281 values between 19.28 and 21.551 values between 26.09 and 28.361 values between 73.79 and 76.06offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. iales
  2. 八
  3. iotic
  4. OLS
  5. 小店
  6. iton
  7. 8
  8. ⼋
  9. urable
  10. 八个

Suppresses

  1. 让他们
  2. Extra
  3. ろ
  4. ery
  5. _extra
  6. Body
  7. mẽ
  8. prolifer
  9. .View
  10. retty