Neuron Explorer

Qwen3-0.6B

comma before an added phrase

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a comma that comes right before an extra phrase which adds detail, like 'important for everyone, not just for people'. Turning it down made the model repeat 'though' endlessly, which points at the words it tends to hold back.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    not smoking, eating right, exercising regularly, staying at a healthy weight, and getting the screening tests you need.⏎A heart-healthy lifestyle is important for everyone, not just for people with existing health problems. It can help you keep

  2. #2 peak

    that chocolate has many other health benefits. Eating chocolate can promote beneficial changes to your blood pressure and cholesterol levels, both of which are good for the heart. Chocolate, especially dark, also contains plentiful levels of antioxidants that neutralize damage done to cells

  3. #3 peak

    why do you think that girls choose few scientific-technical careers?⏎I think the best way to encourage more women into technical careers is to encourage all school children, girls and boys, to develop an interest in science and the way the world works

  4. #4 peak

    functioning of your heating and air conditioning units.⏎Simple solutions can help you manage the ideal indoor levels in your home. Managing humidity should be a priority for every homeowner, especially when tailoring your heating and cooling preferences to meet your personal home needs

  5. #5 peak

    first ever Gender Equality Week from September 23 to 29, 2018!⏎The theme for Gender Equality Week is Gender equality benefits everyone, inspired by the vision of a gender equal society and the benefits of advancing gender equality

  6. #6 peak

    health problems, including heart and blood vessel disease. For help with healthy eating, see these topics:⏎Improving your fitness is good for your heart and blood vessels, as well as the rest of your body. Being active helps lower your risk of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    the info and together with the real-time checksum authentication which the ZFS file system performs on all drives, you will never have to be concerned about losing any information no matter what.<|endoftext|>also a strong stimulator of creativity.⏎It became clear that

  2. #2 peak

    times during his candidacy, and always put on a brave face no matter what the circumstances were, and did what was right no matter what!⏎George Washington was indispensable in launching the U.S government. Although many

  3. #3 peak

    Feelings of frustration⏎* Feelings of incompetence⏎* Feelings of loneliness⏎* Feeling of powerlessness⏎* Believing that things will turn out bad no matter what action is taken⏎* Feelings of low self-esteem⏎* Bel

  4. #4 peak

    during national elections politicians promised us lots of things for free as long as we vote them into power; we complied and in turn demanded for them to fulfil their promises no matter what. We are also given access to social security and food parcels from the

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:2494 strongly suppresses
  2. L19:2919 strongly excites
  3. L18:2396 suppresses
  4. L19:2709 excites
  5. L19:260 excites
  6. L20:302 excites
  7. L19:975 suppresses
  8. L17:2269 excites
  9. L19:2683 suppresses
  10. L20:1764 suppresses
  11. L14:1565 excites
  12. L18:1760 weakly excites
  13. L20:3014 weakly excites
  14. L17:3068 weakly excites comma after a sentence subject
  15. L18:1035 weakly excites
  16. L16:788 weakly excites
  17. L5:86 weakly suppresses
  18. L14:323 weakly excites
  19. L11:997 weakly excites
  20. L2:564 weakly excites
  21. L13:2903 weakly suppresses
  22. L18:2658 weakly suppresses
  23. L19:2296 weakly suppresses
  24. L2:160 weakly suppresses

Feeds later layers

  1. L25:1503 strongly suppresses
  2. L27:1084 suppresses
  3. L24:148 suppresses
  4. L27:789 suppresses
  5. L22:2020 weakly suppresses
  6. L25:1484 weakly excites
  7. L27:1285 weakly suppresses
  8. L27:568 weakly excites
  9. L26:802 weakly suppresses
  10. L26:1666 weakly suppresses
  11. L27:647 weakly suppresses
  12. L23:446 weakly suppresses
  13. L24:961 weakly suppresses
  14. L23:1650 weakly excites
  15. L22:940 weakly suppresses
  16. L25:1366 weakly excites
  17. L24:509 weakly suppresses
  18. L23:2501 weakly excites
  19. L27:760 weakly suppresses
  20. L24:218 weakly excites
  21. L25:2663 weakly suppresses
  22. L22:1375 weakly suppresses
  23. L22:422 weakly excites
  24. L27:987 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -21.56 and -20.871 values between -18.12 and -17.432 values between -12.61 and -11.921 values between -10.54 and -9.851 values between -9.17 and -8.481 values between -8.48 and -7.791 values between -7.10 and -6.413 values between -5.72 and -5.034 values between -5.03 and -4.348 values between -4.34 and -3.6511 values between -3.65 and -2.977 values between -2.97 and -2.2820 values between -2.28 and -1.5937 values between -1.59 and -0.90194 values between -0.90 and -0.212941 values between -0.21 and 0.48610 values between 0.48 and 1.1734 values between 1.17 and 1.866 values between 1.86 and 2.5410 values between 2.54 and 3.235 values between 3.23 and 3.922 values between 3.92 and 4.614 values between 4.61 and 5.304 values between 5.30 and 5.99offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ion
  2. ilda
  3. нима
  4. 飨
  5. 变为
  6. ]]
  7. interface
  8. ndo
  9. ą
  10. 乳

Suppresses

  1. though
  2. 尽管
  3. 虽然
  4. although
  5. Though
  6. Although
  7. 雖然
  8. although
  9. though
  10. Although