Neuron Explorer

Qwen3-0.6B

comma or 'to' before a quotation

A neuron in layer 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the comma or word just before a direct quotation begins, such as 'wrote,' or 'said to' followed by quoted speech. Turning it up made the text produce fragments that look like quoted speech, though often jumbled.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    how the text may add to the child’s knowledge of the topic. For example, if you were reading a book with your child about dogs, you might note, “A Pomeranian, just like Aunt Elaine’s dog! But Princess is

  2. #2 peak

    its relative T. rex, which lived 10-12 million years later. Dr. Mark Loewen, the study’s lead author, noted, “The width of the back of the skull of Lythronax allowed it

  3. #3 peak

    the Lord appeared to them, and the glory of the Lord shone around them, and they were filled with great fear. 10 And the angel said to them, “Fear not, for behold, I bring you good news of

  4. #4 peak

    Piano.⏎Robert Schumann described Chopin’s music as a “cannon buried in flowers,” and in reviewing his musical contemporary in 1831 proclaimed, “Hats off, gentlemen, a genius!” This appreciation has born the test

  5. #5 peak

    delivered by Capt. William Peirce on the ship Desire to the Puritan settlement at Salem, north of Boston. Massachusetts Bay Colony Governor John Winthrop wrote, “Mr. Peirce, in the Salem ship, the Desire, returned

  6. #6 peak

    , p. 137).⏎Also, in an earlier time, Jean-Francois Lyotard (1984) wrote, “In contemporary society and culture — postindustrial society, postmodern culture —

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the first step in the process of the number and its value is to understand the concept of the number, which is the main step, and the next step, and the final step, and the first step of the process of the number,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    closely related to northern Nagari which took its identifiable shape as early as the tenth century A.D. The modern Devanagari, which is now used for writing and printing Sanskrit, Hindi, Nepali, Rajasthani and Marathi

  2. #2 peak

    well as I will create a user who has full priviliges to access drupal database:⏎mysql> create database database_name;⏎mysql> CREATE USER user_name@localhost IDENTIFIED BY '

  3. #3 peak

    3<|endoftext|>: Grade-2 English Games⏎Sight Words is a simple vocabulary and memory exercise for kids. It is designed to introduce kids to some common dolch sight words. Early readers recognize sight words from having memorized them. In this

  4. #4 peak

    .⏎In Years 11 and 12, NSW schools offer a wide variety of languages, catering for beginning students to background speakers.⏎Our Faculty Members⏎Mr John Norberry: email@example.com⏎Mrs Laura Wade: firstname.lastname@example.org

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L6:1127 suppresses
  2. L6:1608 suppresses
  3. L6:2810 suppresses
  4. L6:2077 excites
  5. L4:2578 weakly suppresses
  6. L5:1949 weakly excites
  7. L5:1526 weakly suppresses
  8. L6:2939 weakly suppresses
  9. L1:2217 weakly suppresses unclear: mostly weak, Chinese and Greek characters
  10. L5:1043 weakly suppresses
  11. L5:1582 weakly excites
  12. L6:3011 weakly excites 'in' after a named author or speaker
  13. L6:1132 weakly excites
  14. L5:2344 weakly excites
  15. L5:2241 weakly suppresses
  16. L4:1184 weakly suppresses
  17. L4:2351 weakly suppresses
  18. L1:2109 weakly excites
  19. L4:1185 weakly excites
  20. L2:2358 weakly suppresses
  21. L6:1615 weakly suppresses
  22. L5:2145 weakly suppresses
  23. L1:463 weakly excites
  24. L4:2556 weakly suppresses

Feeds later layers

  1. L11:1544 excites
  2. L17:1424 excites
  3. L11:1485 excites
  4. L16:973 excites
  5. L10:2833 excites
  6. L13:1503 excites
  7. L20:1772 excites
  8. L20:2332 weakly excites
  9. L17:2641 weakly excites
  10. L12:2279 weakly suppresses
  11. L10:902 weakly excites
  12. L17:2784 weakly excites
  13. L17:908 weakly excites
  14. L11:1536 weakly excites
  15. L9:299 weakly excites
  16. L8:2589 weakly excites
  17. L13:1521 weakly excites
  18. L8:1094 weakly excites
  19. L17:1199 weakly excites
  20. L14:536 weakly excites
  21. L12:1934 weakly excites
  22. L21:1019 weakly excites
  23. L9:1078 weakly excites
  24. L9:1484 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.33 and -1.201 values between -1.20 and -1.071 values between -0.82 and -0.692 values between -0.69 and -0.579 values between -0.57 and -0.4455 values between -0.44 and -0.32316 values between -0.32 and -0.191051 values between -0.19 and -0.061560 values between -0.06 and 0.06673 values between 0.06 and 0.19188 values between 0.19 and 0.3230 values between 0.32 and 0.4410 values between 0.44 and 0.575 values between 0.57 and 0.703 values between 0.70 and 0.821 values between 1.45 and 1.581 values between 2.09 and 2.211 values between 3.60 and 3.73offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. :
  2. :host
  3. 雌
  4. better
  5. mieux
  6. command
  7. inn
  8. 蚀
  9. :⏎⏎
  10. :\\

Suppresses

  1. [],⏎
  2. ****⏎
  3. ** ⏎
  4. riority
  5. iversary
  6. __ ⏎
  7. ths
  8. [] ⏎
  9. ([])⏎
  10. **⏎