Neuron Explorer

Qwen3-0.6B

"of" after a noun in "X of Y"

A neuron in layer 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word "of" when it joins a noun to what follows, as in "course of action", "speed of the computer" or "frame of the car". When it was turned up, the model drifted into repeated filler words like "the process of the human life".

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    been no previous indication that Chloroquine has been harmful to pregnant woman.⏎I think that it is important to emphasize that patient panic does not lead to a run of finding this medication on the internet. This drug should be targeted for prevention to high

  2. #2 peak

    of pus⏎- Tiny red spots on the area at the back of the roof of the mouth (soft or hard palate)⏎- Swollen, tender lymph nodes in

  3. #3 peak

    positive or negative.<|endoftext|>Think of your body like a car. Where the muscles are the shock systems and the skeleton (joints/bones) is the frame of the car. The job of the shock system is to absorb any force that is

  4. #4 peak

    the image, the speed of the computer, the number files, and the size and resolution of the selected window

  5. #5 peak

    about virtuous living by thinking over the qualities of each virtue. 2. Meditation can help a child learn to think for themselves, and determine a best course of action by reflecting on possible solutions. 3. If the child is being raised

  6. #6 peak

    feel even worse than before as the infection takes hold.⏎Once you know what is causing your symptoms, you can talk to a pharmacist or doctor about the best course of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: #10000000000000000000000000000000000000000000000

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    and philosophical principles, this is a thorough exploration of the concept and practice of⏎liberalism.ABOUT THE SERIES: The Very Short Introductions series from Oxford University Press contains hundreds of titles in almost every subject area. These pocket-sized

  2. #2 peak

    grass-eating ox.⏎Has a nation ever exchanged its gods?(But they were not gods!)Yet My people have exchanged their Gloryfor useless idols.⏎“Tarshish was your trading partner because of your great wealth of every kind. They exchanged

  3. #3 peak

    “Civil Rights Act” of 1964. The whole world watched in awe and amazement as Neil Armstrong became the first human being to ever set foot on the moon. The

  4. #4 peak

    the input-output pair. It is called supervised learning because the process of an algorithm learning from the training dataset can be thought of as a teacher

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L15:785 suppresses 'of' in set phrases like 'of course'
  2. L6:357 suppresses
  3. L10:469 suppresses 'of' after a noun phrase
  4. L5:363 excites
  5. L17:317 excites 'of' after a noun phrase
  6. L16:1088 excites 'of' after a noun phrase, as in 'of course'
  7. L19:715 excites
  8. L3:315 excites 'of' after a noun phrase
  9. L7:8 excites
  10. L0:40 suppresses 'of' in 'sort of' hedges
  11. L4:4 suppresses
  12. L8:1003 suppresses "the" or "of" before a noun phrase
  13. L4:1686 excites
  14. L4:16 weakly excites
  15. L17:264 weakly suppresses
  16. L0:2726 weakly excites
  17. L6:388 weakly excites
  18. L14:348 weakly suppresses
  19. L3:1379 weakly excites
  20. L13:1515 weakly excites "your" before doctor or health provider
  21. L2:87 weakly excites
  22. L0:1220 weakly suppresses
  23. L6:2956 weakly suppresses
  24. L16:41 weakly suppresses

Feeds later layers

  1. L26:2490 suppresses
  2. L26:1374 suppresses
  3. L26:1179 weakly suppresses
  4. L26:281 weakly suppresses
  5. L23:474 weakly excites
  6. L23:2441 weakly suppresses
  7. L27:325 weakly suppresses
  8. L26:1776 weakly suppresses
  9. L26:693 weakly excites
  10. L26:548 weakly excites
  11. L26:800 weakly suppresses
  12. L25:642 weakly excites
  13. L27:2948 weakly suppresses
  14. L26:193 weakly suppresses
  15. L26:377 weakly suppresses 'sh' starting a word piece
  16. L23:619 weakly suppresses
  17. L26:2178 weakly suppresses the letter 'l' inside words
  18. L24:3008 weakly suppresses
  19. L27:744 weakly suppresses
  20. L26:402 weakly suppresses
  21. L26:1545 weakly suppresses
  22. L23:2833 weakly suppresses
  23. L26:1542 weakly excites
  24. L25:36 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -9.46 and -7.603 values between -7.60 and -5.7415 values between -5.74 and -3.8856 values between -3.88 and -2.02949 values between -2.02 and -0.152531 values between -0.15 and 1.71162 values between 1.71 and 3.5746 values between 3.57 and 5.4329 values between 5.43 and 7.2912 values between 7.29 and 9.153 values between 9.15 and 11.021 values between 11.02 and 12.883 values between 12.88 and 14.743 values between 14.74 and 16.606 values between 16.60 and 18.463 values between 18.46 and 20.327 values between 20.32 and 22.196 values between 22.19 and 24.051 values between 24.05 and 25.916 values between 25.91 and 27.779 values between 27.77 and 29.635 values between 29.63 and 31.492 values between 31.49 and 33.356 values between 33.35 and 35.224 values between 35.22 and 37.086 values between 37.08 and 38.945 values between 38.94 and 40.804 values between 40.80 and 42.661 values between 42.66 and 44.521 values between 44.52 and 46.393 values between 46.39 and 48.255 values between 48.25 and 50.113 values between 50.11 and 51.973 values between 51.97 and 53.832 values between 53.83 and 55.691 values between 55.69 and 57.552 values between 59.42 and 61.281 values between 61.28 and 63.141 values between 63.14 and 65.00offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 她的
  2. igan
  3. hỏi
  4. lie
  5. naissance
  6. 原文地址
  7. reich
  8. xfc
  9. 鲜血
  10. thern

Suppresses

  1. odka
  2. 器
  3. ers
  4. mẽ
  5. oretical
  6. ожет
  7. ute
  8. ive
  9. theless
  10. LETE