Neuron Explorer

Qwen3-0.6B

unclear: word right after a modifier

A neuron in layer 0 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

The neuron tends to fire on a word that comes right after another word that describes it, as in 'joint pain', 'wind speed' or 'ground stations'. It is weakly negative on the '&' or 'of' inside organisation names. Turning it up or down did not produce a clear theme in the text that followed.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Illinois Learning Standards prepare students for the challenges of. The Core Knowledge Preschool Sequence and Teacher Handbook provides

  2. #2 peak

    Six Jewish musicians from the philharmonic were murdered by the Nazis in Austria and 11

  3. #3 peak

    - Trouble concentrating⏎- Joint pain and stiffness⏎- Muscle cramps⏎- Impaired memory⏎- Can’t

  4. #4 peak

    a typhoon if it happened in the northwestern Pacific.⏎WHAT’S THE DIFFERENCE BETWEEN A HURRICANE AND A TROPICAL STORM?⏎Wind speed. When tropical cyclones are just starting out as general areas of low pressure with

  5. #5 peak

    MinneapolisSaint Paul metropolitan place (known as the “Twin Cities”). This place has the largest immersion

  6. #6 peak

    coastal dishes, oyster sauce, fish sauce and Clamato juice⏎Seafood, Molluscs, Crustaceans<|endoftext|>WikipediaRead full entry⏎Mitsukurina is a genus of mackerel shark in

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: this is A the this is A the This IS A THIS is A this IS A this IS a this IS A. this IS A this IS a This IS a this IS A

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    conducted at the Oregon National Primate Research Center at Oregon Health & Science University, monitored the reproductive systems of healthy female nonhuman primates following exposure

  2. #2 peak

    San Tan Allergy & Asthma can help determine whether your (or your child’s) symptoms may be

  3. #3 peak

    . The Sisters of Notre Dame de Namur are becoming more intentionally aware of this responsibility in communities and

  4. #4 peak

    see a lot of diabetes in my clients." exclaims Dr. William H. Wilson, Professor of Psychiatry and Director of Inpatient Psychiatric Services at Oregon Health & Science University.⏎A simple statement that means so much. Considering that Dr. Wilson

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

None: this is the first layer.

Feeds later layers

  1. L4:176 strongly excites
  2. L2:381 excites
  3. L3:169 suppresses
  4. L1:71 suppresses
  5. L10:516 excites
  6. L5:1286 excites
  7. L7:524 suppresses
  8. L16:482 suppresses
  9. L18:2369 suppresses
  10. L3:455 excites unclear: mid-name word fragments
  11. L16:614 excites
  12. L2:3 suppresses
  13. L1:762 suppresses
  14. L20:360 excites
  15. L2:1445 excites
  16. L20:474 suppresses
  17. L1:1154 suppresses
  18. L1:122 suppresses 'World War II' and the 'II' after 'War'
  19. L22:315 suppresses
  20. L17:513 suppresses
  21. L16:158 suppresses
  22. L17:1993 suppresses
  23. L19:903 excites
  24. L3:137 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.56 and -0.522 values between -0.43 and -0.394 values between -0.39 and -0.352 values between -0.35 and -0.318 values between -0.31 and -0.2614 values between -0.26 and -0.2241 values between -0.22 and -0.18120 values between -0.18 and -0.14205 values between -0.14 and -0.10384 values between -0.10 and -0.05689 values between -0.05 and -0.011254 values between -0.01 and 0.03563 values between 0.03 and 0.07299 values between 0.07 and 0.12141 values between 0.12 and 0.1666 values between 0.16 and 0.2038 values between 0.20 and 0.2418 values between 0.24 and 0.2918 values between 0.29 and 0.3315 values between 0.33 and 0.378 values between 0.37 and 0.416 values between 0.41 and 0.453 values between 0.45 and 0.501 values between 0.50 and 0.542 values between 0.54 and 0.582 values between 0.58 and 0.622 values between 0.62 and 0.671 values between 0.88 and 0.921 values between 1.09 and 1.13offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ellung
  2. urga
  3. 十三五
  4. 担
  5. 惠民
  6. bor
  7. 握
  8. CLU
  9. erca
  10. ówn

Suppresses

  1. isposable
  2. gone
  3. _None
  4. Signature
  5. Signature
  6. writes
  7. recht
  8. yses
  9. reeze