Neuron Explorer

Qwen3-0.6B

comma after a vocative or lead-in

A neuron in layer 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a comma that comes right after a short lead-in, such as a name being addressed ("Why would I do that, Marcus?"), an exclamation ("Great work, Shipmates!") or a quoted speaker. Turned up, the model fell into repeating words like "my dear" and "Ms.". The negative side is mostly C code with "void" pointers.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    in My Garden”, beloved local garden guru Carolyn Singer wrote, “’Grandma, why don’t you grow yucky flowers?’ ‘Why would I do that, Marcus?’ I asked, respectful of his three-year-old wisdom. ‘Well,’

  2. #2 peak

    .⏎Resilience is his middle name.⏎Here circumstances are presented as clouds that help trouble and strife to germinate and proliferate.⏎‘This is the world, and we cannot expect to give many hours to pleasure – Circumstances are like

  3. #3 peak

    , as a way of depicting his self-grandeur. In one of her books, another character asks him about it:⏎- Dr. Lutz: Tell me, why do you insist on referring to yourself in the third person? It's intensely

  4. #4 peak

    start through direct mail solicitations. "The shriller you are, the better it is to raise money," explained co-founder Terry Dolan.⏎N

  5. #5 peak

    said Guillaume Gronoff, a French astrophysicist at NASA Langley.⏎"And you think, 'OK, what I am looking at — it's a<|endoftext|>An ultra-

  6. #6 peak

    makes you wonder why Moses included it where he did, or at all. And even more, "Why, now is this seemingly obscure story from the Book of Genesis not only included in the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: what is the value of the value of the value of the value of the value of the value of the value of the value of the value of the value of the value of the value of the value of the value of the value of the

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    conuts and banana leaves<|endoftext|>const void * memchr ( const void * ptr, int value, size_t num );⏎void * memchr ( void * ptr, int value, size_t num );⏎Locate character in block of

  2. #2 peak

    same to a compiler:⏎As humans though, the above is a lot more like gibberish.⏎void * load_model_from_disk(const char *);⏎void draw_model(void *, float, float, float);⏎void deallocate_model(void *);⏎And that is

  3. #3 peak

    ptr.⏎If the value is not found, the function returns a null pointer.⏎In C, this function is only declared as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++

  4. #4 peak

    is recorded in several Roman mosaics.⏎The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept"

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L16:2930 suppresses
  2. L18:1111 excites
  3. L17:2715 weakly suppresses
  4. L19:199 weakly excites
  5. L18:569 weakly excites
  6. L19:650 weakly suppresses
  7. L16:1854 weakly suppresses
  8. L7:62 weakly excites
  9. L19:1662 weakly suppresses
  10. L19:1386 weakly excites
  11. L14:2640 weakly suppresses
  12. L5:158 weakly suppresses
  13. L10:1773 weakly excites
  14. L5:60 weakly excites
  15. L2:2083 weakly excites
  16. L16:1834 weakly excites
  17. L1:1487 weakly suppresses
  18. L15:1122 weakly excites
  19. L2:1583 weakly suppresses
  20. L7:56 weakly suppresses
  21. L5:110 weakly suppresses
  22. L9:846 weakly excites
  23. L19:2672 weakly suppresses
  24. L8:7 weakly excites

Feeds later layers

  1. L22:399 excites
  2. L23:436 excites
  3. L21:772 excites
  4. L25:383 excites
  5. L23:2835 excites
  6. L24:340 excites
  7. L25:343 excites
  8. L22:3063 excites
  9. L21:2385 excites
  10. L27:634 excites
  11. L21:2834 excites
  12. L27:412 weakly excites
  13. L24:1658 weakly excites
  14. L26:970 weakly excites
  15. L22:1296 weakly excites
  16. L23:386 weakly excites
  17. L21:2053 weakly excites
  18. L22:324 weakly excites
  19. L21:696 weakly excites
  20. L22:712 weakly suppresses
  21. L24:2040 weakly excites
  22. L23:24 weakly suppresses
  23. L21:306 weakly excites
  24. L22:368 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

37 values between -1.56 and -0.96329 values between -0.96 and -0.373421 values between -0.37 and 0.23104 values between 0.23 and 0.835 values between 0.83 and 1.422 values between 1.42 and 2.021 values between 2.61 and 3.212 values between 4.40 and 4.993 values between 4.99 and 5.592 values between 5.59 and 6.191 values between 11.55 and 12.141 values between 21.67 and 22.27offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 宝贝
  2. 朋友
  3. 亲爱的
  4. gentlemen
  5. friend
  6. 伙伴
  7. 小伙伴
  8. 同学
  9. buddy
  10. 儿子

Suppresses

  1. 把她
  2. yscale
  3. hers
  4. *self
  5. !)⏎
  6. arı
  7. .cuda
  8. *c
  9. Ticks
  10. .INTER