Neuron Explorer

Qwen3-0.6B

surname pieces split across tokens

A neuron in layer 4 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the middle piece of a surname that the model has split into several chunks, such as the 'og' in Cogliano or the 'ohn' in Bohn. Turning it up made the model's writing wander without any clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    <|endoftext|>It’s official: “…recalls for vaccines and immunoglobulins were higher than other drug classes,” per a recent 72-page report by GBI Research, published March 14, 2012. That report

  2. #2 peak

    turns the receptor on is slightly different," says Dr. Aashish Manglik, a researcher at Stanford University School of Medicine who studies opioid receptors.⏎After Bohn's discovery, a number of people, including a team that includes Manglik,

  3. #3 peak

    April.⏎- Angus Deaton & Olivier Dupriez, 2009. "Purch<|endoftext|>Of Biochemistry and Belief⏎by William Bole⏎Pope John Paul II's recent statement that evolution is more than⏎just

  4. #4 peak

    016.⏎These media resources form part of an on-demand Coursera MOOC run by Frank Cogliano; Professor of American History, David Silkenat; Lecturer,

  5. #5 peak

    in sexual behavior, Lenz and her colleagues silenced the cells in male fetal rats and then observed the rats’

  6. #6 peak

    while playing outside, and he wasn’t sweating enough to properly cool down.⏎The boy, who has autism, was taking several medications — Seroquel, Cogentin and Benadryl — all of which can change the body’s response

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: $ f(x) = -2x^2 + 2x^3 + x^4 + x^5 + x^6 + x^7 + x^8 + x^9 + x^10 + x^

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    the successful deflection of a shot by touching part of the ball on its way to the basket, thereby preventing a field goal⏎Một loại quần short ống rộng vừa vặn, dệt kim hoặc quần soóc nam thường được

  2. #2 peak

    first Shogun was still a good 800 years after the Splitting of Irritaria and Hachiman was probably ruled by an Emperor/ress before the Shoguns took complete power. Samurai probably existed well before the appearance

  3. #3 peak

    932 as the difference in pressure between Ponta Delgada on the Azores and Stykkisholmur in Iceland. More information on the NAO can be found here. See also Arctic

  4. #4 peak

    Education's Institute of Education Sciences to provide educators, policymakers, and the public with a central and trusted source of scientific evidence of what works in education. The WWC is administered by the Department, through a contract to a joint venture of the American

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L2:1417 strongly suppresses
  2. L2:239 strongly suppresses
  3. L1:831 strongly suppresses
  4. L3:1005 suppresses
  5. L1:2283 excites
  6. L0:258 excites
  7. L2:1101 suppresses
  8. L1:637 excites
  9. L0:597 suppresses
  10. L0:667 excites
  11. L1:1256 excites
  12. L3:1688 excites
  13. L0:2551 excites
  14. L1:1533 suppresses
  15. L0:465 suppresses
  16. L2:964 suppresses
  17. L3:861 excites
  18. L1:230 weakly suppresses
  19. L1:1524 weakly suppresses
  20. L3:50 weakly excites
  21. L1:663 weakly excites
  22. L2:1764 weakly suppresses
  23. L1:1336 weakly suppresses
  24. L1:2606 weakly suppresses

Feeds later layers

  1. L16:471 strongly excites blank spot before a year
  2. L18:649 strongly excites
  3. L7:432 strongly excites
  4. L25:422 excites
  5. L19:737 excites
  6. L6:349 excites
  7. L16:2002 excites
  8. L18:1671 excites
  9. L19:479 excites
  10. L15:496 excites
  11. L18:185 suppresses
  12. L17:666 excites
  13. L6:1699 excites
  14. L22:2384 excites
  15. L26:2003 excites hyphen joining two word parts
  16. L5:139 excites
  17. L26:254 suppresses
  18. L22:174 suppresses
  19. L21:2617 excites
  20. L6:394 suppresses
  21. L22:265 excites
  22. L20:396 excites the D in 3D or 2D
  23. L19:548 weakly excites
  24. L26:725 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -0.82 and -0.695 values between -0.69 and -0.5618 values between -0.56 and -0.4386 values between -0.43 and -0.31468 values between -0.31 and -0.181497 values between -0.18 and -0.051507 values between -0.05 and 0.08273 values between 0.08 and 0.2127 values between 0.21 and 0.3410 values between 0.34 and 0.474 values between 0.47 and 0.602 values between 0.60 and 0.732 values between 0.86 and 0.983 values between 1.11 and 1.241 values between 1.63 and 1.761 values between 2.14 and 2.271 values between 2.40 and 2.531 values between 4.20 and 4.33offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. phans
  2. ayas
  3. pen
  4. otype
  5. igation
  6. nog
  7. our
  8. **)&
  9. "S
  10. =S

Suppresses

  1. Won
  2. ⏎ ⏎
  3. hom
  4. mortar
  5. cly
  6. JOR
  7. _inactive
  8. uParam
  9. -thirds
  10. taste