Neuron Explorer

Qwen3-0.6B

comma after an introductory generalization

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a comma that closes a short lead-in phrase, like 'As with most diet choices,' or 'Like all mosquitoes,' right before the main point of the sentence. When it was turned up, the model's text got repetitive and drifted off topic, so the steering output doesn't reveal much more.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    the rate at which your brain ages. Certain habits may slow down the brain aging process, while others may speed it up.⏎As with most diet and lifestyle choices, moderation is key; you shouldn't deprive yourself all the time, but when

  2. #2 peak

    Snakes?⏎What state has the least amount of snakes? That makes Alaska one of two states to be snake-free, the other being Hawaii. As an island, Hawaii is more representative of why most countries without snakes have gotten so lucky: They

  3. #3 peak

    depending on the region and the environment. However, only female mosquitoes can transmit malaria.⏎Like all mosquitoes, the Anopheles species goes through four stages in its life cycle:⏎The first

  4. #4 peak

    myself? Okay, obviously, the paper is about how black flies might be of some use to us. So let’s get to it.⏎Like most biting insects, black flies (

  5. #5 peak

    ilitation. In essence, a protective sheath called myelin is attacked by the body’s own immune system, triggering an inflammatory response.⏎As with many autoimmune diseases, MS is a bit of a mystery. The cause is unknown though more than

  6. #6 peak

    facilitate habits and, for some, sustained compulsivity and addiction. Like other complex illnesses and disorders, addiction is multifactorial, resulting from a combination of genetic, social, psychological

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the first place, the first place, the first place, the first place... the first place... the first place... the first place... the first place, the first place... the first place... the first place... the first place,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    ion vs Empathy: What Is the Difference?⏎What Is Empathy?⏎Empathy is the ability to put yourself in someone else’s shoes. In other words, it’s the ability to feel or understand another person. Experts suggest it’s innate

  2. #2 peak

    is already changing the climate policy discussion both within countries and among them. By showing concretely how 2°C can be achieved and what the enabling conditions are, it is altering the focus from incremental change to transformation, and shining a bright new

  3. #3 peak

    politics changed over time—and how understanding the past sheds light on the current campaign. From the arrival of “dirty politics” to the impact of the “digital revolution,” the course looks at the historical background to some of the key phenomena that shaped the

  4. #4 peak

    home aquarium! These hardy African catfish are popular freshwater aquarium fish due to their beautiful and unique patterning. They’re also relatively easy to care for, making them an ideal choice if you’re just starting out in the hobby of keeping fish

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L12:1285 suppresses
  2. L15:772 excites
  3. L12:2416 excites
  4. L14:736 excites
  5. L14:1993 excites
  6. L15:256 excites
  7. L15:2111 excites
  8. L12:2347 suppresses
  9. L13:1014 suppresses
  10. L13:2636 suppresses
  11. L13:2322 suppresses
  12. L14:2056 suppresses
  13. L15:975 suppresses
  14. L13:407 suppresses
  15. L11:459 excites
  16. L13:251 suppresses
  17. L14:2416 suppresses
  18. L15:391 suppresses
  19. L13:1232 excites
  20. L9:1444 excites
  21. L12:1684 excites comma after a transition word
  22. L14:2381 weakly excites
  23. L15:2479 weakly suppresses
  24. L15:1047 weakly suppresses

Feeds later layers

  1. L18:1860 suppresses
  2. L17:2809 suppresses
  3. L17:1536 suppresses
  4. L17:654 suppresses
  5. L18:2266 suppresses
  6. L18:2903 suppresses
  7. L18:494 suppresses
  8. L21:492 suppresses
  9. L18:2684 excites
  10. L18:2721 suppresses
  11. L26:405 suppresses
  12. L18:1220 suppresses
  13. L19:222 excites
  14. L18:2482 suppresses
  15. L18:183 excites
  16. L19:2766 suppresses
  17. L18:1275 suppresses
  18. L22:1854 suppresses
  19. L27:528 suppresses
  20. L24:803 suppresses
  21. L21:2334 suppresses
  22. L20:42 excites
  23. L18:2713 suppresses
  24. L20:1487 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.37 and -3.211 values between -3.21 and -3.051 values between -2.89 and -2.743 values between -2.74 and -2.582 values between -2.58 and -2.421 values between -2.42 and -2.262 values between -2.26 and -2.107 values between -2.10 and -1.946 values between -1.94 and -1.784 values between -1.78 and -1.626 values between -1.62 and -1.4613 values between -1.46 and -1.3020 values between -1.30 and -1.1418 values between -1.14 and -0.9831 values between -0.98 and -0.8338 values between -0.83 and -0.6755 values between -0.67 and -0.51104 values between -0.51 and -0.35184 values between -0.35 and -0.19585 values between -0.19 and -0.031465 values between -0.03 and 0.13719 values between 0.13 and 0.29379 values between 0.29 and 0.45138 values between 0.45 and 0.6147 values between 0.61 and 0.7719 values between 0.77 and 0.9316 values between 0.93 and 1.0911 values between 1.09 and 1.248 values between 1.24 and 1.4010 values between 1.40 and 1.562 values between 1.56 and 1.723 values between 1.72 and 1.884 values between 1.88 and 2.041 values between 2.04 and 2.202 values between 2.20 and 2.361 values between 2.36 and 2.521 values between 2.84 and 2.99offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. URN
  2. rch
  3. riv
  4. 饱
  5. истории
  6. nbr
  7. xl
  8. ISTRY
  9. ränk
  10. ))/(

Suppresses

  1. 这种方法
  2. 此
  3. this
  4. 这家公司
  5. this
  6. 这里
  7. 这款游戏
  8. 这里是
  9. 这次
  10. 這裡