Neuron Explorer

Qwen3-0.6B

'of' in set noun phrases

A neuron in layer 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

Weakly fires on the word 'of' inside fixed phrases such as 'Seal of', 'Spirit of' or 'tincture of'. The signal is faint, and turning it up did not change the writing in a clear way.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    slowly extinguished in a relentless march to annihilation. In exile, he would reflect on the lessons in a work that, today, ranks among the greatest works of the philosophy of war:⏎“Think, too, of the great part that is

  2. #2 peak

    UPF15 is considered good, with 50+ being the highest. Anything featuring UPF30 or higher receives the Skin Cancer Foundation’s Seal of Recommendation. (1)⏎But

  3. #3 peak

    . It’s the difference between sitting on your butt on the computer or watching TV and moving, just doing something, anything.)⏎- TEF-thermic effect of food. Basically the energy expended to digest and assimilate food into usable energy.⏎

  4. #4 peak

    And so sheep are easy to catch and there’s a lot of meat on them.”⏎We’ll hear more about the Australian Dingo in future programs.⏎Pulse of the Planet is presented with support provided by the National Science Foundation. I’m Jim

  5. #5 peak

    the symptoms of disease⏎tincture of iodine, iodine - a tincture consisting of a solution of iod

  6. #6 peak

    of an unelected, elite class of policymakers. Despite the reverence and appreciation local residents have maintained for the "Spirit of 1776," they now inhabit a world that was reshaped at

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the first and the second and and the of the things, and the of the things. So, the first and the things are, and the of the things, and the things, and the things. So, are they? So,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    0 it gets 1st grade and is very good.⏎If the sheep gets<|endoftext|>|Republic of Latvia⏎|Anthem: Dievs, svētī Latviju!⏎God Bless Latvia!⏎and largest city⏎|Ethnic groups

  2. #2 peak

    is both an art and a science. It is an art because it requires patience and can be built with experience; it is a science because knowing the physics behinds and how they work, can greatly improve your proficiency. Fishing has both been a

  3. #3 peak

    Damage to three or more ligaments may cause joint dislocation.⏎The knee can be divided into three compartments: patellofemoral, medial and lateral compartment. The patellofemoral compartment is

  4. #4 peak

    forced him to leave Rome and work for King Alfonso of Naples (1452-1455), but he resumed his position as papal secretary after Nicholas V's death in 1455 and remained there for

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L6:249 excites
  2. L5:769 suppresses
  3. L2:328 excites 'of' in fixed names and phrases
  4. L5:1299 excites
  5. L2:1175 weakly suppresses
  6. L4:2807 weakly excites
  7. L6:136 weakly suppresses
  8. L4:673 weakly excites unclear: pieces of split words
  9. L0:109 weakly suppresses
  10. L2:2641 weakly excites
  11. L0:2549 weakly excites
  12. L3:1092 weakly suppresses
  13. L2:1788 weakly suppresses
  14. L2:772 weakly excites
  15. L2:943 weakly suppresses
  16. L1:2922 weakly excites
  17. L3:15 weakly excites
  18. L2:1510 weakly excites
  19. L6:775 weakly excites
  20. L4:512 weakly excites
  21. L3:801 weakly suppresses
  22. L0:264 weakly excites
  23. L5:2018 weakly excites
  24. L1:2606 weakly suppresses

Feeds later layers

  1. L9:61 suppresses
  2. L16:337 suppresses
  3. L9:324 suppresses
  4. L16:1590 suppresses
  5. L10:77 suppresses
  6. L9:119 suppresses
  7. L15:798 suppresses
  8. L11:604 suppresses
  9. L15:904 suppresses
  10. L10:37 excites
  11. L11:621 suppresses 'of' inside organization names
  12. L14:148 suppresses closing bracket after an acronym
  13. L10:709 suppresses
  14. L9:2286 suppresses
  15. L10:1218 excites
  16. L9:146 excites
  17. L8:349 suppresses 'of' inside title-like noun phrases
  18. L15:1554 suppresses
  19. L12:77 suppresses
  20. L16:1432 excites
  21. L15:638 suppresses "the" inside institution names
  22. L9:190 suppresses
  23. L15:1855 excites
  24. L15:2906 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.30 and -3.181 values between -2.30 and -2.171 values between -1.92 and -1.802 values between -1.80 and -1.671 values between -1.54 and -1.424 values between -1.42 and -1.294 values between -1.29 and -1.171 values between -1.17 and -1.047 values between -1.04 and -0.927 values between -0.92 and -0.794 values between -0.79 and -0.6713 values between -0.67 and -0.5439 values between -0.54 and -0.4265 values between -0.42 and -0.29162 values between -0.29 and -0.16691 values between -0.16 and -0.041798 values between -0.04 and 0.09726 values between 0.09 and 0.21257 values between 0.21 and 0.3468 values between 0.34 and 0.4616 values between 0.46 and 0.5911 values between 0.59 and 0.7111 values between 0.71 and 0.845 values between 0.84 and 0.973 values between 0.97 and 1.092 values between 1.09 and 1.224 values between 1.22 and 1.342 values between 1.47 and 1.592 values between 1.59 and 1.72offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ingly
  2. theless
  3. lessly
  4. ivating
  5. oba
  6. StatusBar
  7. alyze
  8. Ahead
  9. eker
  10. ivated

Suppresses

  1. given
  2. identical
  3. pen
  4. ctp
  5. ассив
  6. interests
  7. conjug
  8. .Assertions
  9. taken
  10. 两张