Neuron Explorer

Qwen3-0.6B

the word 'Mount' in place names

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word 'Mount' when it begins a mountain or volcano name, such as Mount Everest or Mount Etna. Turning it up did not produce any clear theme in the written text; the output drifted into unrelated or repetitive wording.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    going to do about it?"⏎How about it?<|endoftext|>Published on Feb 20, 2013⏎CBS News RAW: A new eruption on Mount Etna occurred at its South-Eastern crater. This event generated tall lava

  2. #2 peak

    the High Plains.⏎The Rocky Mountains extend from Alaska in the North to New Mexico in the South. Mountainous regions surround high plateaux. The highest mountain is Mount Elbert 14,431 feet.

  3. #3 peak

    the mountain, failed to hear him. They stuck close to the boundary markers, determined to close in and learn what Moses had seen on his quick trip up Mt. Sinai.⏎Suddenly several huge bolts of lightning cracked down from above. Like gigantic swords

  4. #4 peak

    esite stratovolcano in the Islands of Four Mountains, a volcanic group in the Aleutian Arc. Like all stratovolcanoes, Mount Cleveland grew as explosive eru<|endoftext|>EMBL scientists use ‘mini organs’ to clarify

  5. #5 peak

    (17,400 ft); it receives an average of 450 mm (18 in) of precipitation a year. The climate of Mount Everest is extreme

  6. #6 peak

    same in both cases seems to confirm the constancy of h / c. (Annual Report of the Mount Wilson Observatory, 1935-6.) Back.<|endoftext|>I’m

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: Plate台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    ugs, crayfish, tadpoles and frogs and fish. They’ll also mix in some plant stuff.⏎They are ground nesters, building platforms, or mounds, of cattails or

  2. #2 peak

    . Natural shorelines are often more resilient against erosion and have more beneficial relationships to the surrounding environment and animals compared to armored shorelines, such as bulkheads, seawalls, and rock revetments.⏎Working with partner organizations and local groups,

  3. #3 peak

    standing calf raises, chest flyes and pull-down exercises on these machines. Other types of weight-training exercises require you to move your own body weight. These include triceps dips<|endoftext|>A paper clip

  4. #4 peak

    of hunters and gatherers.⏎Now, new research in the current issue of the journal Geoarchaeology, offers compelling evidence that one of the massive earthen mounds at Poverty Point was constructed in less than 90 days, and perhaps

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L23:1082 suppresses
  2. L20:1969 excites
  3. L15:2975 suppresses
  4. L22:1020 excites
  5. L23:1874 suppresses
  6. L6:2850 weakly suppresses
  7. L4:1048 weakly suppresses
  8. L7:2457 weakly suppresses
  9. L10:1683 weakly suppresses
  10. L22:938 weakly excites
  11. L21:2700 weakly suppresses
  12. L23:704 weakly suppresses
  13. L22:2375 weakly excites
  14. L24:2978 weakly excites
  15. L14:1448 weakly excites
  16. L20:2226 weakly excites
  17. L7:2186 weakly suppresses
  18. L11:1650 weakly suppresses
  19. L21:2499 weakly excites
  20. L20:2067 weakly excites
  21. L8:360 weakly excites
  22. L10:1360 weakly suppresses
  23. L1:2674 weakly suppresses
  24. L2:1516 weakly excites

Feeds later layers

  1. L27:2730 weakly suppresses
  2. L27:1115 weakly suppresses
  3. L26:2129 weakly suppresses
  4. L27:2452 weakly suppresses
  5. L27:683 weakly suppresses
  6. L26:1816 weakly suppresses
  7. L27:675 weakly suppresses
  8. L26:2083 weakly suppresses
  9. L26:367 weakly suppresses
  10. L26:1615 weakly excites
  11. L26:450 weakly suppresses
  12. L27:2003 weakly suppresses
  13. L26:3039 weakly suppresses
  14. L26:573 weakly suppresses
  15. L27:1885 weakly suppresses
  16. L27:2984 weakly suppresses
  17. L26:977 weakly suppresses
  18. L27:2373 weakly suppresses
  19. L27:1892 weakly suppresses
  20. L27:1090 weakly excites
  21. L27:1040 weakly suppresses
  22. L27:1325 weakly suppresses
  23. L27:446 weakly suppresses
  24. L27:1898 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -21.72 and -20.831 values between -18.15 and -17.261 values between -17.26 and -16.371 values between -14.58 and -13.691 values between -11.02 and -10.137 values between -10.13 and -9.232 values between -9.23 and -8.344 values between -8.34 and -7.451 values between -7.45 and -6.563 values between -6.56 and -5.675 values between -5.67 and -4.787 values between -4.78 and -3.8817 values between -3.88 and -2.9916 values between -2.99 and -2.1042 values between -2.10 and -1.21574 values between -1.21 and -0.322896 values between -0.32 and 0.58215 values between 0.58 and 1.4741 values between 1.47 and 2.3616 values between 2.36 and 3.2524 values between 3.25 and 4.149 values between 4.14 and 5.043 values between 5.04 and 5.932 values between 5.93 and 6.824 values between 6.82 and 7.716 values between 7.71 and 8.603 values between 8.60 and 9.492 values between 9.49 and 10.391 values between 10.39 and 11.282 values between 12.17 and 13.061 values between 13.06 and 13.95offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ✏
  2. �回
  3. }}],⏎
  4. allis
  5. 殃
  6. нев
  7. phet
  8. ognito
  9. aneously
  10. ⏎⏎⏎

Suppresses

  1. 台
  2. 台上
  3. 臺
  4. plate
  5. Plate
  6. plates
  7. 板
  8. plates
  9. plate
  10. -platform