Neuron Explorer

Qwen3-0.6B

unclear: pieces of names and acronyms

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a fragment of a longer name, acronym or word, such as the Y in YSN or the CHE in Che Guevara. Its pattern is hard to pin down, and turning it up mostly made the model repeat itself or drift into odd word fragments.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    -scientific scommunities about your work⏎AIMES, in collaboration with the UK, held five Young Scholar’s Network (YSN) workshops. The YSN goal

  2. #2 peak

    ⏎- Paper: #87743533⏎Excerpt from Essay :⏎Perceptions of Che Guevera⏎PERCEPTIONS OF CHE GUEVARA⏎Che Guevara was born as Ernesto Gue

  3. #3 peak

    to remove soot from diesel emissions in 1978, just a few years after the famed catalytic converter substrate. But like many environmental technologies, DPFs were initially viewed as an unnecessary luxury since diesel engine manufacturers easily met the

  4. #4 peak

    Woman's Board of Missions of the Interior, located in Chicago (WBMI), the Woman's Board of Missions for the Pacific, located in San Francisco (WBMP), and the Woman's Board of Missions for the Pacific Islands,

  5. #5 peak

    ⏎Vireos. On occasion, good numbers may be encountered, especially in late⏎August and throughout September. Numbers decline thereafter and by November⏎any Warbling Vireo is rather scarce and late.⏎Warbling Vireo is a

  6. #6 peak

    offers two different day programs that support the opportunity to gain life-enhancing skills, interact with the community, and gain more independence. Learn more by visiting https://www.lsahomes.org/our-programs/⏎- Help your child incorporate the act

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I just dived in the waterbender benden, and I was in the position of dreebuna (duna) in a benden, and I was in a duna (cage) with a duna b

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    0|⏎When requesting a correction, please mention this item's handle: RePEc:taf:jeduce:v:42:y:2011:i:2:p

  2. #2 peak

    that cover vast areas of water. Find out what happens when other microbes hitch a ride.⏎Get more reference information on Phormidium pseudpriestleyi.⏎Phormidium pseudpriestleyi isolated from a

  3. #3 peak

    and S to CA; var. melanocarpa – E to AB and S to NM, AZ, NV and N CA; var. leucocarpa – E to PQ and NB and S<|endoftext|>A Classical African Conception of Womanhood

  4. #4 peak

    or discuss; as, I reasoned the matter with my friend.⏎9. (v. t.) To support with reasons, as a request.⏎10. (v. t.) To persuade by

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:2048 excites
  2. L17:528 excites
  3. L15:2 excites
  4. L18:304 excites
  5. L18:22 excites
  6. L20:263 suppresses
  7. L20:912 suppresses
  8. L14:1949 weakly excites
  9. L8:1433 weakly suppresses
  10. L1:1428 weakly excites
  11. L16:653 weakly suppresses
  12. L10:116 weakly suppresses
  13. L15:1707 weakly excites
  14. L1:2316 weakly excites
  15. L18:34 weakly excites
  16. L19:119 weakly suppresses
  17. L18:846 weakly suppresses
  18. L15:3035 weakly suppresses
  19. L14:1452 weakly excites
  20. L12:226 weakly suppresses
  21. L14:1810 weakly excites
  22. L14:229 weakly excites
  23. L13:2349 weakly excites
  24. L3:2760 weakly suppresses

Feeds later layers

  1. L22:224 strongly suppresses
  2. L23:363 excites
  3. L22:1393 excites
  4. L26:539 excites
  5. L24:166 suppresses
  6. L25:2507 excites
  7. L26:386 suppresses
  8. L27:316 suppresses
  9. L24:710 excites
  10. L22:1784 excites
  11. L24:561 suppresses
  12. L26:1756 excites
  13. L25:2443 excites
  14. L23:404 excites
  15. L25:246 suppresses
  16. L24:355 suppresses
  17. L26:977 suppresses
  18. L25:593 suppresses
  19. L23:383 excites
  20. L27:830 weakly suppresses
  21. L26:321 weakly suppresses
  22. L22:1182 weakly suppresses
  23. L23:133 weakly excites
  24. L25:1080 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -6.36 and -6.081 values between -6.08 and -5.811 values between -5.81 and -5.531 values between -4.71 and -4.431 values between -4.43 and -4.161 values between -4.16 and -3.882 values between -3.88 and -3.614 values between -3.33 and -3.062 values between -2.78 and -2.514 values between -2.51 and -2.233 values between -2.23 and -1.968 values between -1.96 and -1.6817 values between -1.68 and -1.4123 values between -1.41 and -1.1332 values between -1.13 and -0.8665 values between -0.86 and -0.59265 values between -0.59 and -0.311327 values between -0.31 and -0.041804 values between -0.04 and 0.24251 values between 0.24 and 0.5245 values between 0.52 and 0.7914 values between 0.79 and 1.0613 values between 1.06 and 1.347 values between 1.34 and 1.614 values between 1.61 and 1.891 values between 1.89 and 2.162 values between 2.16 and 2.443 values between 2.44 and 2.712 values between 2.71 and 2.991 values between 2.99 and 3.262 values between 4.09 and 4.361 values between 4.36 and 4.64offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 功
  2. OE
  3. 鸠
  4. 酌
  5. 尸
  6. ję
  7. etal
  8. 号线
  9. antro
  10. 分行

Suppresses

  1. ONGO
  2. ripp
  3. xFFF
  4. Pandora
  5. ratt
  6. xFFFF
  7. :r
  8. ipple
  9. ivicrm
  10. @g