Neuron Explorer

Qwen3-0.6B

'a' before 'lot', 'little' or 'bit'

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word 'a' when it starts a phrase like 'a lot' or 'a little', as in 'may seem a lot'. When it was pushed up, the model kept writing 'bit' again and again, showing it is tied to phrases of degree.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    .aei.org/publication/the-omnivores-delusion-against-the-agri-intellectuals/⏎Leave a ReplyWant to join the discussion?⏎Feel free to contribute!<|endoftext|>Tree Roots Can

  2. #2 peak

    as share their experiences. It does not matter which way you choose to study, as long as it works for you and you stay engaged. Sometimes it may seem a lot to remember, and there is where a curriculum might come in handy. You

  3. #3 peak

    me about 2nd conditionals, but I'm a safe bet for what reads well in (American) English.⏎Me too. I

  4. #4 peak

    are seldom used compared to other documents such as site maps and wireframes, I'm a huge fan and see them as one of the most important design documents we produce as

  5. #5 peak

    ⏎I’ve put together a comprehensive bundle of over 15 products for practically every Fine Motor Skills Alphabet Activity you can possibly think of! However, it’s a rapidly growing bundle and I’ve got even more ideas coming down the pike!⏎

  6. #6 peak

    voice. They evolved as my thinking about blogging evolved. So, here is what I’ve learned along the way:⏎1. Encourage discourse.⏎It may feel a little contrived, but I’ve found that providing discourse stems and sample questions helps

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or or

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    2014 – Rapport au Ministre chargé de la Sécurité Sociale et au Parlement sur l’évolution des charges et produits de l’Assurance Maladie au titre de 2014 (

  2. #2 peak

    method to make massive inroads in retail sales, betting quite rightly on the loyalty of Quebec Francophones.⏎Canadian Heritage Information Network⏎Mission de la recherche et de la technologie, Direction des Musées de France, Musée de la civil

  3. #3 peak

    Some Autistics Are Pleading⏎By AMY HARMON⏎Published: December 20, 2004⏎Jack Thomas, a 10th grader at a school for autistic teenagers and an expert on the nation

  4. #4 peak

    in 18th Century exploration. These engravings provide a delightful view of the discoveries, people and customs of the Pacific region.⏎A. Terre de Kerguelen, Appellee par M. Cook, Isle de la

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:751 strongly excites the article 'a' before a noun
  2. L23:703 strongly suppresses
  3. L22:83 suppresses
  4. L23:266 suppresses
  5. L17:391 suppresses
  6. L17:188 excites 'a' before a noun phrase
  7. L16:191 suppresses
  8. L18:1380 suppresses
  9. L4:137 excites
  10. L16:880 suppresses
  11. L22:1881 excites
  12. L16:97 suppresses
  13. L20:901 suppresses
  14. L2:1770 excites
  15. L16:118 suppresses
  16. L16:139 excites
  17. L16:8 suppresses
  18. L16:2054 suppresses 'an' in definitions and descriptions
  19. L14:392 suppresses
  20. L9:59 weakly suppresses "a" meaning per (a day, a year)
  21. L20:114 weakly suppresses
  22. L25:366 weakly suppresses
  23. L20:212 weakly suppresses
  24. L18:3 weakly excites

Feeds later layers

  1. L27:387 strongly suppresses 'a' right after 'played' or 'play'
  2. L27:2632 strongly suppresses
  3. L27:2097 strongly excites
  4. L27:1678 excites
  5. L27:1292 excites
  6. L27:601 weakly excites
  7. L27:146 weakly excites
  8. L27:1587 weakly excites
  9. L27:800 weakly excites
  10. L27:763 weakly excites
  11. L27:1655 weakly excites
  12. L27:782 weakly suppresses
  13. L27:2677 weakly suppresses
  14. L27:3014 weakly excites
  15. L27:1412 weakly excites
  16. L27:2164 weakly suppresses
  17. L27:918 weakly excites
  18. L27:1726 weakly excites
  19. L27:617 weakly excites
  20. L27:822 weakly excites
  21. L27:2014 weakly excites
  22. L27:780 weakly suppresses
  23. L27:236 weakly excites
  24. L27:1633 weakly excites unclear: scattered mid-phrase words

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -47.66 and -45.991 values between -39.33 and -37.671 values between -36.01 and -34.341 values between -34.34 and -32.681 values between -32.68 and -31.013 values between -31.01 and -29.353 values between -29.35 and -27.682 values between -27.68 and -26.028 values between -26.02 and -24.352 values between -24.35 and -22.693 values between -22.69 and -21.033 values between -21.03 and -19.363 values between -19.36 and -17.704 values between -17.70 and -16.037 values between -16.03 and -14.376 values between -14.37 and -12.704 values between -12.70 and -11.042 values between -11.04 and -9.372 values between -9.37 and -7.712 values between -7.71 and -6.053 values between -6.05 and -4.383 values between -4.38 and -2.727 values between -2.72 and -1.053551 values between -1.05 and 0.61264 values between 0.61 and 2.2813 values between 2.28 and 3.941 values between 3.94 and 5.611 values between 8.94 and 10.601 values between 12.26 and 13.931 values between 13.93 and 15.592 values between 15.59 and 17.262 values between 17.26 and 18.92offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. bit
  2. extension
  3. environment
  4. exponent
  5. experiment
  6. excuse
  7. obst
  8. example
  9. index
  10. env

Suppresses

  1. 到
  2. 考虑到
  3. ,在
  4. 走到
  5. 看你
  6. 的不同
  7. 的责任
  8. 的质量
  9. 灶
  10. 力还是