Neuron Explorer

Qwen3-0.6B

"of" in "Battle of"

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "of" in battle names like "Battle of Midway" or "Battle of Gettysburg". Turning it up did not give a clear theme, and the output drifted into lists of numbers or unrelated sentences.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    ), attaching the choline groups to the tips of the “branches”. The<|endoftext|>This month marks 50 years since the Battle of Ia Drang Valley, the first major fight between the U.S. Army

  2. #2 peak

    6 min 1 sec Sound:Yes⏎German campaign during The Battle of Crete. Troops establish camps in Crete. They open tents and light

  3. #3 peak

    US had stopped the Japanese ships from supporting an invasion of Port Moresby, New Guinea, and the proposed air assault on Australia.⏎Next came the great Battle of Midway in June, again between United States and Japanese ships. This time US

  4. #4 peak

    of this aircraft", describes Quick. "The Canadians used it to great effect both during Normandy during the softening up and post-landings for the Battle of Caen.”⏎The aircraft was actually discovered in the United States after the war and

  5. #5 peak

    from avenue parking|⏎The North Carolina Monument is a North Carolina memorial of the American Civil War commemorating the 32 Carolina regiments in action at the Battle of Gettysburg. The monument is a public artwork by American sculptor G

  6. #6 peak

    of Donauworth in Bavaria following the swift but costly Battle of Schellenberg. When the French and Bavarians avoided further battle or negotiation,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 -

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Use ANOVA – single factor in Excel’s Data Analysis ToolPak to test whether there is a relationship between the two variables. Use an alpha of 10% Show your hypotheses, ANOVA output, and decision – referring to

  2. #2 peak

    earnings up by more than $400,000 compared to an average teacher. The symmetry of the calculations prevail: A poor teacher at the 16th percentile (100-84) produces a negative

  3. #3 peak

    ) you will obtain your answer:⏎F'(x) = 2x√(1+x6)⏎Comment. There is no need to integrate and then differentiate by x

  4. #4 peak

    of capital, or they will invest elsewhere.⏎The following is the WACC calculation formula:⏎WACC = E/V × Re + D/V × Rd × (1 - Tc)⏎Re = cost of equity⏎Rd = cost of debt

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:1671 excites
  2. L20:2892 excites
  3. L6:2390 excites
  4. L17:1166 excites
  5. L18:266 suppresses
  6. L0:3051 excites
  7. L18:2084 suppresses
  8. L14:1272 weakly excites
  9. L18:2436 weakly suppresses
  10. L18:1713 weakly excites
  11. L19:2968 weakly excites
  12. L17:1062 weakly excites
  13. L6:1645 weakly excites
  14. L8:2641 weakly excites
  15. L11:1401 weakly excites
  16. L18:831 weakly excites
  17. L20:1927 weakly excites
  18. L19:1968 weakly suppresses
  19. L19:2046 weakly suppresses
  20. L14:333 weakly suppresses
  21. L20:1008 weakly suppresses
  22. L16:1480 weakly suppresses
  23. L8:2364 weakly excites
  24. L8:2741 weakly suppresses

Feeds later layers

  1. L23:520 suppresses
  2. L22:1577 suppresses
  3. L23:304 suppresses
  4. L22:1128 suppresses
  5. L24:1928 weakly suppresses
  6. L25:2337 weakly suppresses
  7. L24:2174 weakly excites
  8. L24:1742 weakly excites
  9. L22:611 weakly suppresses
  10. L24:1710 weakly suppresses
  11. L25:2964 weakly excites
  12. L25:749 weakly suppresses
  13. L22:1298 weakly excites
  14. L26:99 weakly excites
  15. L26:1730 weakly suppresses
  16. L27:1131 weakly excites
  17. L23:544 weakly excites "Great" in proper place names
  18. L25:1250 weakly suppresses
  19. L22:1672 weakly suppresses
  20. L24:2964 weakly excites
  21. L22:2280 weakly excites
  22. L25:457 weakly suppresses
  23. L23:1894 weakly suppresses
  24. L25:2550 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

60 values between -1.69 and -0.842384 values between -0.84 and 0.021408 values between 0.02 and 0.8829 values between 0.88 and 1.746 values between 1.74 and 2.602 values between 2.60 and 3.464 values between 4.32 and 5.185 values between 5.18 and 6.042 values between 6.04 and 6.892 values between 7.75 and 8.611 values between 8.61 and 9.471 values between 12.91 and 13.761 values between 15.48 and 16.341 values between 17.20 and 18.061 values between 18.06 and 18.921 values between 31.80 and 32.66offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. atak
  2. енко
  3. 围
  4. suburbs
  5. buch
  6. outer
  7. ictory
  8. ongan
  9. ucher
  10. ahren

Suppresses

  1. minus
  2. ancest
  3. .addRow
  4. personals
  5. .configureTestingModule
  6. .addChild
  7. ễ
  8. -parent
  9. +a
  10. 働