Neuron Explorer

Qwen3-0.6B

'the' right before 'subject' or 'source'

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to the word 'the' in sentences like 'has been the subject of study' or 'became the source of conflict', where a word like 'subject' is expected next. When it was turned up, the model kept producing 'the subject of the focus' again and again.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    means, and these attempts have a high scientific interest on account of the mystery which surrounds the natural origin of this remarkable mineral. Its physical and chemical properties have been the subject of much study

  2. #2 peak

    accessed here. You can also read the full article published in Transactions of the Institute of British Geographers here.⏎Ethnic diversity in English city neighbourhoods has been the subject of longstanding public interest. While some have argued that diversity is associated with lower

  3. #3 peak

    under a Creative Commons Attribution 4.0 International License.<|endoftext|>How do you explain how babies are made to an 8-year-old?⏎This topic has been the subject of countless jokes over the

  4. #4 peak

    practices. But at the same time, there are enough differences to make the two religions and cultures oppose each other greatly. Even some similarities between the two have been the source of conflict for thousands of years.⏎Both the Jewish and Muslim faith believe in

  5. #5 peak

    . There are over a hundred lakes and ponds in the mire, many quite small. Only a few have names; these are medium-sized lakes which have been the subject of several studies.⏎On the map below several lakes are named. Using the

  6. #6 peak

    and covering the period from 1319 to 1367. The book's stories had great popularity in the nineteenth century, when they became the subject of musha-e, prints depicting warriors, drawn by Kuniyoshi

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: this is a 8-digit a,3,3,3,3,3,3,2,3,3,2,2,3,3,3,2,3,3,2,2,3,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    . Never Go Swimming Alone⏎You should continuously swim with a mate unless you're swimming in a swimming pool or a lake.⏎Remember that the lifeguard isn't your "swim buddy"; when on duty, they have a lot of people to

  2. #2 peak

    Dehydration can make you more vulnerable to illness and infections, therefore, it is important that you down plenty of non-alcoholic fluids. And if water isn’t your thing, juice, tea, and other beverages

  3. #3 peak

    washed away oils.⏎This can make your ferret smell worse.⏎If you are looking for a hypoallergenic pet, then a ferret may not be your best choice. However, if you don’t have any sensitivities to particular smells

  4. #4 peak

    (Gardenia spp.) are recommended for growth in U.S. Department of Agriculture plant hardiness zones 8 and above, cool temperatures are not the plant’s only enemy. The plant also requires humidity to look its best, which is why

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:2531 excites
  2. L20:2247 suppresses
  3. L18:2949 excites
  4. L20:1540 suppresses
  5. L8:2519 excites
  6. L15:1668 suppresses
  7. L15:2692 excites 'to' after a noun, before a purpose verb
  8. L18:2232 excites
  9. L18:780 suppresses
  10. L17:1310 suppresses
  11. L17:2985 excites
  12. L17:1262 excites
  13. L19:2132 excites
  14. L20:1253 suppresses
  15. L16:2038 suppresses
  16. L5:1395 excites
  17. L5:2141 excites
  18. L18:1502 suppresses
  19. L17:2756 suppresses
  20. L20:2026 excites
  21. L19:1910 weakly suppresses
  22. L16:2091 weakly suppresses
  23. L19:820 weakly excites
  24. L15:2257 weakly suppresses unclear: word stems in technical text

Feeds later layers

  1. L22:2708 excites
  2. L24:2468 excites
  3. L27:2480 excites
  4. L25:2948 excites
  5. L23:916 excites
  6. L27:127 suppresses
  7. L25:2215 excites
  8. L27:399 weakly excites
  9. L23:1486 weakly excites
  10. L23:2966 weakly excites
  11. L23:2711 weakly excites
  12. L25:2040 weakly excites
  13. L26:507 weakly excites
  14. L23:2838 weakly excites
  15. L22:1336 weakly excites
  16. L27:1039 weakly excites
  17. L22:438 weakly excites
  18. L27:1376 weakly excites
  19. L23:94 weakly suppresses
  20. L27:1292 weakly suppresses
  21. L23:556 weakly suppresses
  22. L23:748 weakly excites
  23. L27:1327 weakly excites
  24. L23:2951 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -7.64 and -6.981 values between -6.98 and -6.321 values between -6.32 and -5.661 values between -5.00 and -4.341 values between -4.34 and -3.682 values between -3.68 and -3.031 values between -3.03 and -2.376 values between -2.37 and -1.7132 values between -1.71 and -1.05614 values between -1.05 and -0.392757 values between -0.39 and 0.27354 values between 0.27 and 0.9348 values between 0.93 and 1.5927 values between 1.59 and 2.2511 values between 2.25 and 2.9116 values between 2.91 and 3.569 values between 3.56 and 4.223 values between 4.22 and 4.885 values between 4.88 and 5.546 values between 5.54 and 6.202 values between 6.86 and 7.521 values between 7.52 and 8.181 values between 8.18 and 8.841 values between 8.84 and 9.492 values between 9.49 and 10.151 values between 10.15 and 10.811 values between 10.81 and 11.471 values between 11.47 and 12.131 values between 18.06 and 18.72offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. subject
  2. basis
  3. subjects
  4. 对象
  5. source
  6. focus
  7. subject
  8. Subject
  9. object
  10. basis

Suppresses

  1. STER
  2. ewise
  3. ApplicationBuilder
  4. asz
  5. 行った
  6. Dungeons
  7. asti
  8. ingly
  9. 记者采访
  10. Stern