Neuron Explorer

Qwen3-0.6B

the 'A' that starts a word fragment

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a capital A that begins the second half of a longer word or name, like the A in Ahab, Aids or Ama Dablam. When it was turned up, the model's writing just got rambling and off-topic, so the steering does not show a clear effect.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    , after Bayek left Siwa and A<|endoftext|>The mushroom spawn is any constituent that has been injected with mycelium –

  2. #2 peak

    .” While many in these professions verify this pessimistic outlook, does the Bible also discourage serving in such positions?⏎Consider wicked rulers in Old Testament times such as King Ahab and Queen Jezebel, who instituted Ba

  3. #3 peak

    al worship and slaughtered God’s prophets. Or King Ahasverus, who ordered the mass genocide of the Jews. Nehemiah faced

  4. #4 peak

    and her newfound Roman ally Julius Caesar joined with the Order and protected Lucius Septimius, one of their remaining members. Released from service yet feeling betrayed, Aya and Bayek founded the Hidden Ones to resume the fight against the Order,

  5. #5 peak

    , said it was every child's right to have proper access to sex education as well as psychological and social support.⏎Speaking in Geneva at a meeting on children and Aids organised by the Committee on the Rights of the Child, he said: "

  6. #6 peak

    u or Everest region⏎The major mountains are the Mt.Everest, Mt.Lhotse, Cho Oyu, Nuptse, Pumori, Ama Dablam

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: what if notimbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbitbit

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    : a peaked cap.⏎- adj. Having a sickly appearance: You're looking a little peaked today.⏎from Wiktionary, Creative Commons Attribution/Share-Alike License⏎- adj. Having a peak or peaks.⏎- adj. Sick

  2. #2 peak

    , Sweden, and Finland and the Kola Peninsula of northwest Russia. It is largely within the Arctic Circle.⏎from Wiktionary, Creative Commons Attribution/Share-Alike License⏎- proper n. The northern parts of Scandinavia and Finland with

  3. #3 peak

    , Creative Commons Attribution/Share-Alike License⏎- n. use, practise, exercise.⏎- v. To

  4. #4 peak

    in underwater installations and conduct, assist in, or be a subject of scientific research. Also called oceanaut.⏎from Wiktionary, Creative Commons Attribution/Share-Alike License⏎- n. An underwater explorer.⏎from WordNet 3.

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L23:2833 strongly excites
  2. L22:457 excites
  3. L19:1083 excites
  4. L20:1273 suppresses
  5. L21:1072 suppresses
  6. L18:102 suppresses
  7. L16:880 suppresses
  8. L11:689 excites
  9. L4:137 excites
  10. L19:751 excites the article 'a' before a noun
  11. L7:520 weakly suppresses
  12. L4:4 weakly excites
  13. L16:76 weakly suppresses
  14. L17:188 weakly excites 'a' before a noun phrase
  15. L20:174 weakly excites
  16. L21:518 weakly excites
  17. L19:2088 weakly suppresses
  18. L2:1866 weakly suppresses
  19. L6:357 weakly excites
  20. L20:901 weakly suppresses
  21. L6:1393 weakly excites
  22. L18:2208 weakly excites
  23. L19:283 weakly excites
  24. L18:296 weakly excites

Feeds later layers

  1. L27:657 weakly suppresses
  2. L27:2491 weakly suppresses
  3. L27:1528 weakly suppresses
  4. L27:2352 weakly excites
  5. L27:2512 weakly excites
  6. L27:2731 weakly suppresses
  7. L27:2099 weakly suppresses
  8. L27:1871 weakly excites
  9. L27:1461 weakly excites
  10. L27:2273 weakly suppresses
  11. L27:828 weakly suppresses
  12. L27:2309 weakly excites
  13. L27:2524 weakly excites
  14. L27:1826 weakly excites
  15. L27:686 weakly excites
  16. L27:609 weakly suppresses
  17. L27:475 weakly suppresses
  18. L27:2802 weakly excites
  19. L27:2378 weakly suppresses
  20. L27:692 weakly suppresses 'Ch' starting a proper name
  21. L27:185 weakly excites
  22. L27:1996 weakly excites
  23. L27:2578 weakly suppresses
  24. L27:2434 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -48.34 and -45.642 values between -21.29 and -18.581 values between -18.58 and -15.881 values between -15.88 and -13.171 values between -13.17 and -10.472 values between -10.47 and -7.765 values between -7.76 and -5.0619 values between -5.06 and -2.353660 values between -2.35 and 0.36182 values between 0.36 and 3.0618 values between 3.06 and 5.773 values between 5.77 and 8.473 values between 8.47 and 11.183 values between 11.18 and 13.881 values between 13.88 and 16.591 values between 16.59 and 19.291 values between 19.29 and 22.001 values between 27.41 and 30.121 values between 35.53 and 38.231 values between 46.35 and 49.051 values between 57.17 and 59.88offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. arges
  2. sheets
  3. Award
  4. ten
  5. itionally
  6. cription
  7. ty
  8. sing
  9. tes
  10. 请您

Suppresses

  1. uctions
  2. zhou
  3. bit
  4. uction
  5. yen
  6. vore
  7. ABB
  8. bps
  9. 万户
  10. quí