Neuron Explorer

Qwen3-0.6B

'the' in 'what are the' questions

A neuron in layer 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'the' in questions that start with 'what are the' or 'what's the', just before the thing being asked about. Turning it up did not produce a clearly related change in the model's replies.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    . Do you grab a disposable one or do you get one that you can recharge? For that matter, why can’t you recharge all of them? What’s the difference? That, turns out, is a matter of science and cost.⏎How

  2. #2 peak

    V. That’s 10% of the intended voltage!⏎So what are the traditional options? Well, the best one is to have a separate set of wires

  3. #3 peak

    ?⏎- Kidney stones⏎- Polycystic kidney disease⏎- Diabetic Nephropathy⏎- Renal tubular acidosis⏎What are the symptoms of

  4. #4 peak

    system?⏎8. Why are program counter and stack pointer 16-bit registers?⏎9. What does it mean by embedded system?⏎10. What are the different addressing modes in 8085?⏎11

  5. #5 peak

    Best guess: the water rushing over the microphone of the hearing aid makes a loud rushing sound.⏎If I can’t swim with my waterproof hearing aids, what’s the point?⏎Your waterproof hearing aid is more durable in the case of accidental water sub

  6. #6 peak

    most frustrating behaviors a dog owner can experience. It not only disturbs your sleep but also gives you the sense that the dog is not comfortable. So what are the reasons why dogs growl?⏎Here’s The Sort Answer To Why Your Dog Grow

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I need to be a student of a "simpler" student, who can write a small, formal letter. This letter, as a student of a "simpler" student, who can write a small, formal letter,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    the first generation of transgenics came from observing the way that agrobacterium infects plants

  2. #2 peak

    for anything;⏎There is no such a thing as a free lunch, someone has paid for it. Government doesn’t have money of its

  3. #3 peak

    is often diagnosed during a visit to your doctor. Blood pressure is measured using a cuff around your arm and a device called a sphygmomanometer. Your doctor may ask you to sit quietly for five

  4. #4 peak

    and silica), is connected to the wheel and/or the axle. To stop the wheel, friction material in the form of brake pads (mounted on a device called a brake caliper) is forced mechanically, hydraulically, pneumatically or electrom

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L5:125 excites "of" after all three, both, ten
  2. L5:1372 excites
  3. L4:128 suppresses
  4. L2:2172 suppresses
  5. L4:52 weakly excites
  6. L3:615 weakly excites
  7. L3:159 weakly excites
  8. L5:1747 weakly suppresses
  9. L4:812 weakly suppresses
  10. L2:1126 weakly suppresses
  11. L4:2786 weakly excites
  12. L4:1743 weakly suppresses
  13. L4:2589 weakly suppresses
  14. L5:2649 weakly excites
  15. L3:1456 weakly suppresses
  16. L2:2250 weakly excites
  17. L1:1147 weakly excites
  18. L4:731 weakly excites
  19. L1:1967 weakly excites
  20. L5:2619 weakly excites
  21. L3:585 weakly suppresses
  22. L2:516 weakly suppresses 'had' after has or have
  23. L3:473 weakly suppresses
  24. L4:2365 weakly suppresses

Feeds later layers

  1. L14:727 excites
  2. L9:459 weakly suppresses
  3. L7:15 weakly excites
  4. L10:272 weakly excites
  5. L24:1887 weakly excites
  6. L25:655 weakly excites
  7. L16:485 weakly suppresses
  8. L10:459 weakly suppresses
  9. L8:1003 weakly suppresses "the" or "of" before a noun phrase
  10. L7:135 weakly suppresses 'of' after 'issue' in citations
  11. L24:108 weakly excites
  12. L9:266 weakly suppresses
  13. L18:264 weakly suppresses
  14. L18:370 weakly suppresses
  15. L20:321 weakly excites
  16. L27:1696 weakly suppresses
  17. L26:981 weakly suppresses
  18. L20:1314 weakly suppresses
  19. L14:2955 weakly excites
  20. L10:1132 weakly excites
  21. L20:229 weakly excites
  22. L22:237 weakly excites
  23. L14:672 weakly suppresses
  24. L16:2207 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -1.97 and -1.861 values between -1.86 and -1.752 values between -1.75 and -1.641 values between -1.64 and -1.542 values between -1.54 and -1.433 values between -1.43 and -1.323 values between -1.32 and -1.214 values between -1.21 and -1.103 values between -1.10 and -0.995 values between -0.99 and -0.898 values between -0.89 and -0.7811 values between -0.78 and -0.6713 values between -0.67 and -0.5627 values between -0.56 and -0.4545 values between -0.45 and -0.34100 values between -0.34 and -0.24284 values between -0.24 and -0.131027 values between -0.13 and -0.021748 values between -0.02 and 0.09419 values between 0.09 and 0.20108 values between 0.20 and 0.3125 values between 0.31 and 0.4226 values between 0.42 and 0.5214 values between 0.52 and 0.637 values between 0.63 and 0.745 values between 0.74 and 0.854 values between 0.85 and 0.961 values between 0.96 and 1.072 values between 1.07 and 1.181 values between 1.18 and 1.283 values between 1.28 and 1.391 values between 1.39 and 1.501 values between 1.50 and 1.611 values between 1.61 and 1.721 values between 2.26 and 2.37offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. iology
  2. gings
  3. 把手
  4. ник
  5. 要说
  6. ToShow
  7. otypes
  8. forc
  9. iggers
  10. śl

Suppresses

  1. ourn
  2. lưới
  3. isted
  4. ently
  5. -mask
  6. così
  7. ATE
  8. adan
  9. apsed
  10. ivered