Neuron Explorer

Qwen3-0.6B

the word 'only' mid-sentence

A neuron in layer 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'only' when it appears inside a sentence, such as 'only some schools participate' or 'only succeed academically'. Turning it up made the model's text fill with 'only' and 'one' type phrasing, so the link to the word is somewhat visible.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    | It's the simple things in life that are the most extraordinary; only wise men are able to understand them (15). | He looked at the

  2. #2 peak

    downloading data from the Cloud onto mobile devices, most do not know where the data comes from. Digital information is stored in minute magnetic dots written in layers that are only a few nanometers thick that cover the surface of millions of saucer-sized spinning

  3. #3 peak

    serinus), a rare plant that only exists in a 25-square-kilometer area straddling the borders

  4. #4 peak

    Collins Dictionary⏎To add entries to your own vocabulary, become a member of Reverso community or login if you are already a member.⏎It's easy and only takes a

  5. #5 peak

    order for the school to qualify for CEP. If some schools in a district are eligible and others are not, the district may opt for partial implementation, meaning only some schools participate. Ventura Unified School District in California opted for this arrangement and report

  6. #6 peak

    final FDA approval, a drug must be tested in humans in Phase I, Phase II, and Phase III clinical studies.⏎- Developing a new drug is complicated—only one in 5,000 compounds that begin in

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have to, now, to, and, already, on, ... something. So, first, I have already, split, something, first, in, something, split, first, split, first, split, first, or

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    , 5, 10, 15, 20, 25, 30, 40, 50 and <|endoftext|>

  2. #2 peak

    ) equal in magnitude but have opposite direction⏎C) not equal in magnitude but have the same direction⏎D) not equal in magnitude but have opposite direction⏎E) None of the above⏎In a uniform circular motion, which of the following

  3. #3 peak

    the United States.⏎The National Science Foundation CARE<|endoftext|>Territorial A-ZA | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q |

  4. #4 peak

    the acronym Family ASSESSMENT—Structure, Socioeconomic, Sickness, Nutritional, Educational, Environmental, Affordability, System (health), Mental, Family influence, Threats. Under each domain,

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L9:729 weakly suppresses
  2. L1:1035 weakly suppresses
  3. L7:2149 weakly excites
  4. L9:1920 weakly excites
  5. L0:588 weakly suppresses
  6. L8:2579 weakly suppresses
  7. L10:110 weakly excites
  8. L1:1221 weakly suppresses
  9. L7:2803 weakly excites
  10. L2:2238 weakly suppresses
  11. L9:1670 weakly suppresses
  12. L4:1232 weakly suppresses
  13. L1:561 weakly excites
  14. L14:624 weakly excites
  15. L14:184 weakly suppresses
  16. L10:1957 weakly suppresses
  17. L1:263 weakly excites
  18. L4:1142 weakly excites
  19. L4:1212 weakly excites
  20. L11:682 weakly excites gap before a second number
  21. L7:1052 weakly suppresses
  22. L1:1827 weakly excites
  23. L11:2802 weakly excites
  24. L2:705 weakly excites

Feeds later layers

  1. L18:726 suppresses
  2. L16:724 suppresses
  3. L18:410 suppresses
  4. L18:844 suppresses
  5. L16:51 suppresses
  6. L17:1451 excites "only" in "it is only" constructions
  7. L17:1412 weakly suppresses
  8. L19:879 weakly suppresses
  9. L16:209 weakly suppresses
  10. L16:147 weakly suppresses
  11. L18:1070 weakly suppresses
  12. L16:96 weakly suppresses
  13. L16:1358 weakly suppresses
  14. L23:336 weakly suppresses
  15. L17:128 weakly suppresses
  16. L16:127 weakly suppresses
  17. L18:924 weakly suppresses
  18. L21:318 weakly excites
  19. L16:8 weakly suppresses
  20. L19:996 weakly suppresses the digit 5 inside numbers
  21. L16:44 weakly suppresses
  22. L17:299 weakly suppresses
  23. L23:1114 weakly excites
  24. L22:523 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -3.20 and -3.011 values between -2.44 and -2.251 values between -2.25 and -2.061 values between -2.06 and -1.872 values between -1.68 and -1.493 values between -1.49 and -1.311 values between -1.31 and -1.125 values between -1.12 and -0.936 values between -0.93 and -0.7419 values between -0.74 and -0.55141 values between -0.55 and -0.36629 values between -0.36 and -0.171711 values between -0.17 and 0.021042 values between 0.02 and 0.21265 values between 0.21 and 0.4040 values between 0.40 and 0.5915 values between 0.59 and 0.786 values between 0.78 and 0.974 values between 0.97 and 1.161 values between 1.16 and 1.345 values between 1.34 and 1.531 values between 1.53 and 1.722 values between 1.72 and 1.912 values between 1.91 and 2.101 values between 2.48 and 2.671 values between 2.67 and 2.861 values between 4.18 and 4.37offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. one
  2. one
  3. _one
  4. onen
  5. otypes
  6. ooth
  7. 喆
  8. One
  9. остей
  10. One

Suppresses

  1. -divider
  2. itur
  3. alloc
  4. illo
  5. RoutingModule
  6. ResultsController
  7. teenth
  8. Inflater
  9. alloc
  10. ไ