Neuron Explorer

Qwen3-0.6B

colon introducing an explanation

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a colon ":" that comes right after a statement and introduces an explanation, a list or an example. Turning it down made the model fill its text with colons, so the neuron is tied to that punctuation mark.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    the properties all the solutions a given set of equations have is more important than finding a particular solution: this leads into some of the deepest areas in all of mathematics, both conceptually

  2. #2 peak

    in the Miami area who, for whatever reason, cannot get to a⏎safe and dark observing site: check out the locations where the⏎Southern Cross Astronomical Society⏎(Phone

  3. #3 peak

    needs of each student.⏎The Referendum funds numerous resources, including technology for media center Maker Spaces, which are collaborative areas where students can create, invent and explore:<|endoftext|>Many

  4. #4 peak

    don't want to send all the coins you got from the transaction, so you also specify how much change you are sending to another address, usually controlled by yourself: "I got

  5. #5 peak

    the Land Registry proposes the Land Titles Bill by the replacement of current deeds registration system. However, such proposal has no intention to deal with the long neglected land rights: boundary extent.”⏎Hong Kong represents a unique territory where the history of land division,

  6. #6 peak

    significant effect to decrease depression score of the mental disorder patients of Banyumas public hospital. Two times cognitive therapy was more effective than once therapy. The cognitive therapy: cognitive restructuritation has a significant effect to decrease dep ression score

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately:: and: 2010/11: 2010/1/1: 2020/1/1: 2020/1/1: 2020/

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    -October, Australia reported over 200,000 cases of the flu. In 2009, they had under 60,000 cases.⏎Even in the United States, where flu season starts later

  2. #2 peak

    waged war on White people, especially women.⏎- Asian-Americans are illiterate, undesirable, full of “filth and disease” and unassimilable. They were perceived as “marginal members of the human race,” were denied

  3. #3 peak

    so many people now philosophically insist that mandatory mask mandates are unconstitutional? We’ll resist answering that question as it involves a political discussion beyond the scope of this post. But we will textually discuss whether mask mandates are unconstitutional. And they’re not

  4. #4 peak

    uth” era where the opinions of experts are viewed with skepticism, where everyone’s opinions are equally valid and opposing views (and evidence) dismissed as “fake news”; and secondly, the sharing of information through the Internet and social media, personalized

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L12:2674 strongly suppresses
  2. L12:2503 strongly excites
  3. L4:193 excites
  4. L3:77 excites
  5. L9:396 excites colon after a metadata label
  6. L15:2901 excites
  7. L13:1771 excites
  8. L13:2606 excites
  9. L5:134 suppresses
  10. L0:319 excites blank space after a label colon
  11. L2:872 suppresses
  12. L13:2215 excites
  13. L15:2620 excites
  14. L14:51 excites colon that introduces a statement
  15. L5:75 excites
  16. L0:1301 suppresses
  17. L16:149 excites
  18. L0:2833 suppresses
  19. L0:1224 suppresses
  20. L0:178 weakly suppresses
  21. L16:43 weakly suppresses
  22. L16:567 weakly excites
  23. L13:1139 weakly suppresses
  24. L16:95 weakly excites

Feeds later layers

  1. L23:236 strongly suppresses
  2. L26:122 strongly suppresses
  3. L20:1077 strongly suppresses
  4. L25:4 strongly excites
  5. L20:841 strongly suppresses
  6. L19:1790 excites
  7. L18:2254 excites colon before a subtitle
  8. L27:858 suppresses
  9. L25:745 suppresses
  10. L20:1313 suppresses
  11. L27:646 suppresses
  12. L25:430 suppresses
  13. L24:1896 suppresses
  14. L19:1755 excites
  15. L23:171 excites
  16. L27:1266 suppresses
  17. L26:582 suppresses
  18. L19:973 excites
  19. L27:753 weakly suppresses
  20. L21:113 weakly excites
  21. L22:731 weakly suppresses
  22. L18:1380 weakly excites
  23. L18:282 weakly excites
  24. L18:445 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

150 values between -1.82 and -1.13848 values between -1.13 and -0.452898 values between -0.45 and 0.231 values between 0.23 and 0.911 values between 0.91 and 1.601 values between 17.29 and 17.981 values between 17.98 and 18.662 values between 18.66 and 19.341 values between 19.34 and 20.021 values between 20.02 and 20.711 values between 20.71 and 21.391 values between 22.07 and 22.751 values between 24.12 and 24.801 values between 24.80 and 25.48offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. سنة
  2. ferences
  3. explos
  4. sWith
  5. ствие
  6. сел
  7. pieces
  8. IMM
  9. المصدر
  10. .AF

Suppresses

  1. :
  2. ’:
  3. :⏎⏎
  4. ”:
  5. ):
  6. ":
  7. ':
  8. :</
  9. :')
  10. :',