Neuron Explorer

Qwen3-0.6B

the 'a' after 'not' or 'just'

A neuron in layer 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word 'a' when it comes right after words like 'Not', 'Just' or 'what exactly'. It goes quiet, or dips, on words like 'almost', 'only' and 'usually' that come before a word such as 'usually' or 'certainly'. Turning it up did not produce any clear theme in the written text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    you would be willing to participate."⏎After a moment's hesitation, the confederate agreed and started to get up. The experimenter then said "Just a moment," and turned to the subject and repeated the same request. If the subject

  2. #2 peak

    uncontrolled terrestrial conditions according to evolutionists, still cannot be synthesised even in the most sophisticated, high-tech laboratories of the 20th century. Not a single "transitional form", creatures which are supposed to show the gradual evolution of

  3. #3 peak

    hour long debate. The panelists argued amongst themselves about what exactly a service or a microservice means. By the end of the debate I doubt any

  4. #4 peak

    kids busy. Look around you and spot something ANYTHING that either you don’t see often or haven’t seen in awhile (not a person) and get excited while smiling and saying, “OMG you are never

  5. #5 peak

    that must have surrounded the temples in ancient times. The principal feature in Egyptian social centers, and usually the only one to have survived, was the temple. Not a place for collective worship but rather a house of the gods, only the temple's

  6. #6 peak

    tools to use technology are a problem.⏎All classrooms do not look like the schema above. For one thing teachers using technology often are in an active classroom. Not a lot of sitting down happens.⏎Or the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the way of a particular idea, and the way of a particular idea. So, you have been, and the way of a particular idea. So, the, and the way of a particular idea. So, the, and the way

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    actually unearthed in 2008, and while last year it was reported that they were suspected to be from a new species, the researchers have only now announced that they have found certain unique aspects to the fossil that definitively prove their

  2. #2 peak

    eye. Those who take blood thinners as maintenance are more probable to experience this. These bleeds don’t cause loss of vision or pain. They will almost usually clear up in just a week or two.⏎Serious Causes of Eye Redness

  3. #3 peak

    muscle pain, making it difficult to exit the water.⏎People who swim together can help or seek assistance in a crisis. Plus, swimming with a friend will almost certainly

  4. #4 peak

    is the most powerful hormone in the human body, because growth, in some ways, is really helpful from insulin. If you’re trying to grow muscle and just obviously stay alive<|endoftext|>The international language of many industries is English, and English is the

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:1792 excites
  2. L1:604 excites
  3. L1:1055 excites
  4. L1:969 excites
  5. L1:2470 suppresses
  6. L1:602 weakly suppresses
  7. L1:1007 weakly excites name pieces inside a multi-part word
  8. L1:454 weakly excites
  9. L1:136 weakly suppresses
  10. L0:2376 weakly excites
  11. L1:1016 weakly suppresses
  12. L0:15 weakly suppresses
  13. L1:2556 weakly excites
  14. L1:171 weakly excites "but" after a negated clause
  15. L1:2105 weakly suppresses
  16. L1:1667 weakly excites
  17. L1:2800 weakly suppresses
  18. L0:1999 weakly excites
  19. L0:2571 weakly excites
  20. L0:571 weakly excites
  21. L1:2604 weakly excites
  22. L0:2126 weakly suppresses
  23. L0:1729 weakly suppresses
  24. L0:1974 weakly suppresses

Feeds later layers

  1. L17:2986 excites
  2. L15:791 weakly suppresses
  3. L14:1011 weakly suppresses
  4. L16:2625 weakly suppresses
  5. L13:2041 weakly suppresses
  6. L25:643 weakly suppresses
  7. L6:1122 weakly excites
  8. L22:2006 weakly suppresses
  9. L4:1645 weakly excites
  10. L23:347 weakly suppresses
  11. L12:1536 weakly excites
  12. L15:2713 weakly suppresses
  13. L19:2585 weakly suppresses
  14. L27:2859 weakly suppresses
  15. L27:324 weakly suppresses
  16. L17:2928 weakly suppresses
  17. L7:979 weakly suppresses middles of split scientific compound words
  18. L10:654 weakly excites
  19. L16:1671 weakly excites
  20. L4:2895 weakly excites 'all' in 'at all' phrases
  21. L16:1972 weakly suppresses
  22. L16:538 weakly excites
  23. L6:2758 weakly excites
  24. L14:2502 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -1.20 and -1.111 values between -1.11 and -1.021 values between -1.02 and -0.935 values between -0.85 and -0.763 values between -0.76 and -0.674 values between -0.67 and -0.584 values between -0.58 and -0.4912 values between -0.49 and -0.4014 values between -0.40 and -0.3257 values between -0.32 and -0.23264 values between -0.23 and -0.14653 values between -0.14 and -0.051741 values between -0.05 and 0.04751 values between 0.04 and 0.13218 values between 0.13 and 0.2281 values between 0.22 and 0.3044 values between 0.30 and 0.3917 values between 0.39 and 0.489 values between 0.48 and 0.576 values between 0.57 and 0.665 values between 0.66 and 0.744 values between 0.74 and 0.831 values between 0.83 and 0.925 values between 0.92 and 1.012 values between 1.10 and 1.191 values between 1.36 and 1.451 values between 1.63 and 1.721 values between 1.80 and 1.891 values between 2.25 and 2.33offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. likely
  2. explicitly
  3. directly
  4. other
  5. quicker
  6. 直接
  7. sooner
  8. store
  9. other
  10. intended

Suppresses

  1. itivity
  2. 叼
  3. 鲜血
  4. imity
  5. 或多
  6. 翡
  7. inges
  8. 这种事情
  9. apas
  10. tractive