Neuron Explorer

Qwen3-0.6B

"a" before "bit" or "little"

A neuron in layer 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "a" when it comes before "bit", "little" or "lot", as in "a little bit" or "a lot like". Turned up, the model wrote mostly about "a bit" type phrases in a jumbled way. Steering results mostly looked unrelated.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    . Sometimes a part of the melody will lend itself to particular words. Go with them if they sound right and fit the melody perfectly, even if the words clash a little bit with the rest of the lyrics or don't even make sense. Many

  2. #2 peak

    important in pop music. Be willing to cut a word or two here or there to make it fit. If you have to, change the melody a bit. Use this to your advantage at different parts of the<|endoftext|>Also found in

  3. #3 peak

    one how it moves its movements and how they regard each other sending rays to one another,<|endoftext|>Down with Zero Tolerance⏎It might be time to ease up a bit when it comes to disruptive students and detention. The American Psychological Association (APA

  4. #4 peak

    el each other slightly. This effect is mostly canceled out due to the strong attraction to the nucleus, but it does cause electrons in the same shell to spread out a little bit. Lower shells experience this effect more

  5. #5 peak

    for 50 minutes. I’m very deliberate about the progression and flow of my lectures. I believe that students tend to get sort of tired and space out a bit if a lecture on any topic goes on and on in the same way,

  6. #6 peak

    a cone⏎- Glue the nose onto the face using a dot of glue on the nose (this allows⏎the mustache to stick out from the edges a bit in a slightly 3d manner).⏎- Gl

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    ponges if animal sponges did not exist.⏎Sponges live under water. Most sponges

  2. #2 peak

    , the two members consisted of a Candida strain of infectious yeast and an antibiotic-resistant pathogenic bacterial strain, such as Enterococcus faecium or Staphylococcus aureus, the researchers report in mBio® this week.⏎

  3. #3 peak

    of Kolkata (and the location of Writers’ Building) – gets its name.<|endoftext|>Article: Palaeoecology of the mid-Cretaceous siphonate bivalve genus Goshoraia(Mollusca, Vener

  4. #4 peak

    time; in fact, scientists think that some live sponges could be as many as 5,000 years old.⏎The

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L17:188 excites 'a' before a noun phrase
  2. L20:901 suppresses
  3. L19:751 excites the article 'a' before a noun
  4. L16:880 suppresses
  5. L4:137 excites
  6. L9:59 suppresses "a" meaning per (a day, a year)
  7. L18:1547 weakly excites
  8. L0:19 weakly excites
  9. L14:245 weakly suppresses
  10. L13:373 weakly excites
  11. L18:828 weakly suppresses
  12. L8:629 weakly suppresses
  13. L16:2248 weakly excites
  14. L2:3039 weakly excites
  15. L19:1007 weakly excites
  16. L8:73 weakly suppresses
  17. L15:2619 weakly excites
  18. L4:128 weakly suppresses
  19. L21:1072 weakly suppresses
  20. L16:2239 weakly excites
  21. L14:255 weakly excites
  22. L20:14 weakly suppresses
  23. L11:1675 weakly excites
  24. L9:2971 weakly excites

Feeds later layers

  1. L25:2820 suppresses
  2. L25:2580 weakly excites
  3. L23:2823 weakly suppresses
  4. L23:2460 weakly suppresses
  5. L26:1149 weakly excites
  6. L25:1380 weakly suppresses
  7. L23:1846 weakly suppresses
  8. L27:185 weakly excites
  9. L23:2791 weakly suppresses
  10. L27:506 weakly excites
  11. L25:1283 weakly excites
  12. L26:2458 weakly excites
  13. L23:1987 weakly suppresses
  14. L24:1875 weakly suppresses
  15. L25:1849 weakly suppresses
  16. L23:3011 weakly suppresses
  17. L24:1025 weakly suppresses
  18. L24:368 weakly suppresses
  19. L27:666 weakly excites
  20. L27:1509 weakly excites
  21. L23:2881 weakly excites
  22. L24:2892 weakly excites
  23. L26:1329 weakly suppresses
  24. L24:1668 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

3 values between -12.96 and -10.926 values between -10.92 and -8.884 values between -8.88 and -6.848 values between -6.84 and -4.809 values between -4.80 and -2.76163 values between -2.76 and -0.713614 values between -0.71 and 1.3329 values between 1.33 and 3.3724 values between 3.37 and 5.4116 values between 5.41 and 7.456 values between 7.45 and 9.497 values between 9.49 and 11.536 values between 11.53 and 13.582 values between 13.58 and 15.624 values between 15.62 and 17.661 values between 17.66 and 19.701 values between 19.70 and 21.741 values between 23.78 and 25.821 values between 27.86 and 29.901 values between 33.99 and 36.031 values between 62.56 and 64.611 values between 66.65 and 68.69offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. bit
  2. bit
  3. little
  4. _bit
  5. lot
  6. →bit
  7. amilies
  8. 小
  9. /bit
  10. Bit

Suppresses

  1. easiest
  2. eller
  3. ATIVE
  4. 中最
  5. 地上
  6. ellers
  7. tiği
  8. serter
  9. hence
  10. 反正