Neuron Explorer

Qwen3-0.6B

the digit 3 inside years

A neuron in layer 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the digit 3 when it sits inside a year or date, such as 1853, 1983 or 2001-12-31. The steered outputs did not show a clear theme, so it is hard to say what turning it up does.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Scale Biosphere-Atmosphere|⏎|Time Period||1985-01-01 to 2001-12-31|⏎This data set includes classified land cover transition maps at 30-m

  2. #2 peak

    roman books⏎The works translated the following take care of significant subject matters within the considering St Augustine (354-430): loose will and divine grace. at the one hand, unfastened

  3. #3 peak

    the poor. Therefore, the people waited for the Messiah or Christ.⏎The word Christmas, or "Christes Maesse," was first used in 1038. Until then, it was known as Nativity Feast. Christmas is Latin

  4. #4 peak

    _class_altemira.tif||30.7 MB||1985-01-01 - 2001-12-31||2.50S To 4.00S||5

  5. #5 peak

    value than it does now. According to the U.S. Treasury, the closest that the nation ever was to being debt free was during the years 1835 and 1<|endoftext|>Fibromyalgia is a disorder characterized by widespread

  6. #6 peak

    of Middlebourne, may well have been the first to develop a practical method for transmitting messages over wire. His success came on March 3, 1838, more than six years before Samuel B. Morse successfully transmitted a message over

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the idea that the opposite side of the 'g' to the 'g' is the same as the 'g' to the 'g' to the 'g' (like the 'g' to 'a' to 'k'

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    University.⏎During the first project phase, three extensive field surveys were conducted along the coastline of Saudi Arabia in 2011, 2012 and 2013 in order to access the biodiversity of the nearshore and

  2. #2 peak

    Life. And a hike through that exhibit and underwater viewing tunnel brings encounters with three polar bears, a gray seal, two harbor seals, one harp seal and three arctic fox.⏎A visit to the Arctic Ring of Life is more than a

  3. #3 peak

    011.5 hours in this first year of study and recorded 671 unique contacts – 277 bonytail, 383 razorback sucker, and 11 individuals with no database record.⏎Based on

  4. #4 peak

    .S. hosted the Olympics for the first time in 1904, in St. Louis. The third Olympiad marked the first time gold, silver and bronze medals were given out to first, second and third-place finishers.⏎Starting

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L18:1023 strongly excites the digit 3 inside numbers
  2. L16:134 strongly excites
  3. L4:347 strongly excites
  4. L0:1108 strongly suppresses
  5. L17:994 excites
  6. L2:1774 excites
  7. L2:1866 suppresses
  8. L19:1615 suppresses
  9. L18:750 excites
  10. L19:647 excites
  11. L16:671 excites
  12. L18:569 excites
  13. L19:196 suppresses
  14. L18:420 suppresses
  15. L2:1518 excites
  16. L15:129 suppresses
  17. L16:400 excites
  18. L15:80 suppresses
  19. L15:96 suppresses
  20. L10:1210 suppresses
  21. L10:722 weakly excites
  22. L2:1724 weakly suppresses
  23. L5:1984 weakly excites
  24. L17:134 weakly excites

Feeds later layers

  1. L21:1189 strongly excites
  2. L23:2650 excites
  3. L22:3071 excites
  4. L21:325 suppresses
  5. L23:1670 suppresses 'the' before river names
  6. L23:840 excites
  7. L25:2807 excites
  8. L26:1090 weakly excites
  9. L27:2850 weakly excites
  10. L24:2955 weakly excites
  11. L22:1550 weakly suppresses
  12. L27:2318 weakly excites
  13. L22:3051 weakly excites
  14. L26:733 weakly suppresses
  15. L23:2376 weakly excites
  16. L21:2627 weakly suppresses
  17. L24:2262 weakly excites
  18. L27:285 weakly excites
  19. L24:2466 weakly excites
  20. L25:2442 weakly excites
  21. L27:533 weakly suppresses
  22. L25:1702 weakly excites
  23. L25:396 weakly suppresses
  24. L26:1279 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -5.84 and -4.3929 values between -2.93 and -1.483576 values between -1.48 and -0.02274 values between -0.02 and 1.435 values between 1.43 and 2.894 values between 2.89 and 4.353 values between 4.35 and 5.803 values between 5.80 and 7.263 values between 7.26 and 8.711 values between 8.71 and 10.174 values between 10.17 and 11.621 values between 17.44 and 18.901 values between 26.18 and 27.631 values between 27.63 and 29.091 values between 30.54 and 32.001 values between 50.92 and 52.38offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. rd
  2. rd
  3. -quarters
  4. ʳ
  5. →rd
  6. RD
  7. cheers
  8. viso
  9. (rd
  10. rgan

Suppresses

  1. -thirds
  2. stri
  3. ously
  4. thing
  5. strate
  6. fully
  7. Warp
  8. keh
  9. 德尔
  10. kee