Neuron Explorer

Qwen3-0.6B

colon after a said or explains verb

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

The neuron fires on the colon that comes right after a speaker phrase, like "Professor Bill Davies said:" just before a quote. Turning it up made the model produce strings of asterisks and blanks, which have nothing to do with quotes.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    device, and warn them when they are at risk of a seizure and how they can modify their behaviour or change their situation to prevent this.”⏎Professor Schelter added: “We live in a world where there is a massive amount of data, and

  2. #2 peak

    unique partnership between the BBC, the British Museum and 350 museums and institutions across the country.⏎Director of The Manchester Museum, Dr Nick Merriman said: "It's

  3. #3 peak

    how brain circuits are arranged.⏎Andrew Leuchter, director of the Semel Institute’s TMS clinical and research centre (University of California, LA) explains: "By pulsing it with energy repeatedly, we’re changing the way that area

  4. #4 peak

    to a global market.⏎One of the problems of existing vaccines against foot and mouth disease is identifying which animals have been vaccinated and which haven't.⏎Dr Charleston says: 'The complete absence of some viral proteins from this new vaccine will also allow companion

  5. #5 peak

    used to help reduce the engine's fuel consumption.⏎Commenting on the projects, Project lead and Lecturer in the Department of Mechanical Engineering, Dr Copeland said: "These two research projects are at the cutting edge of research in turbomachinery

  6. #6 peak

    Professor Bill Davies has been exploring the challenges likely to be posed by global population growth for the UK’s first free online course in food security.⏎Professor Bill Davies said: “Food security is one of the grand challenges facing the world, there is going

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: if we are in a situation where we are in the first time we are in the situation we are in the first time we are in the situation, we are in a situation we are in the situation we are in the situation we are in

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    by Sam.⏎Example of Present Perfect: Active: Many tourists have visited that castle. Passive: That castle has been visited by many tourists.⏎Example of Future (Will): Active: Tonight, John will wash the dishes. Passive: Tonight, the

  2. #2 peak

    Related research" (further below) or search for a different version of it.⏎Volume (Year): 42 (2011)⏎Issue (Month): 2 (June)⏎|Contact details of provider:|| Web page:

  3. #3 peak

    . I'll see her tomorrow.⏎In #1 "going to" implies a previous arrangement or understanding.⏎In #2 "will" does not carry the implication of an arrangement, and can be a spontaneous decision

  4. #4 peak

    his father not died? (9) They had returned the home? (10)You had finished this book?⏎Past Perfect Tense Negative⏎Subject + had not + verb 3rd from + object.⏎Past Perfect Interrogative Negative

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:2793 excites
  2. L20:1772 excites
  3. L19:1817 suppresses
  4. L20:2552 excites
  5. L19:1160 suppresses
  6. L14:177 suppresses
  7. L19:991 suppresses
  8. L18:2015 excites
  9. L20:79 excites
  10. L19:223 excites
  11. L19:836 excites
  12. L13:1550 suppresses
  13. L19:1326 excites
  14. L18:228 suppresses
  15. L19:2075 excites
  16. L19:1153 excites
  17. L15:1601 suppresses
  18. L14:2651 suppresses
  19. L19:2226 excites
  20. L19:1156 excites
  21. L18:652 suppresses
  22. L20:353 excites
  23. L18:725 suppresses
  24. L6:850 excites

Feeds later layers

  1. L22:161 excites
  2. L25:135 suppresses
  3. L27:193 weakly suppresses
  4. L23:43 weakly excites
  5. L23:444 weakly suppresses
  6. L22:165 weakly suppresses
  7. L24:121 weakly excites
  8. L25:420 weakly suppresses
  9. L24:132 weakly excites
  10. L23:122 weakly suppresses
  11. L23:420 weakly suppresses
  12. L27:338 weakly suppresses
  13. L25:16 weakly excites
  14. L25:334 weakly suppresses
  15. L26:554 weakly suppresses
  16. L27:1698 weakly suppresses
  17. L24:20 weakly excites
  18. L27:498 weakly suppresses
  19. L24:331 weakly suppresses
  20. L24:125 weakly suppresses
  21. L26:356 weakly excites
  22. L22:108 weakly excites
  23. L23:881 weakly suppresses
  24. L26:757 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -6.66 and -6.161 values between -6.16 and -5.664 values between -5.66 and -5.162 values between -5.16 and -4.663 values between -4.66 and -4.176 values between -4.17 and -3.6710 values between -3.67 and -3.1722 values between -3.17 and -2.6719 values between -2.67 and -2.1749 values between -2.17 and -1.6780 values between -1.67 and -1.18155 values between -1.18 and -0.68429 values between -0.68 and -0.181677 values between -0.18 and 0.32877 values between 0.32 and 0.82151 values between 0.82 and 1.3294 values between 1.32 and 1.8179 values between 1.81 and 2.3152 values between 2.31 and 2.8142 values between 2.81 and 3.3135 values between 3.31 and 3.8131 values between 3.81 and 4.3124 values between 4.31 and 4.8015 values between 4.80 and 5.307 values between 5.30 and 5.808 values between 5.80 and 6.307 values between 6.30 and 6.807 values between 6.80 and 7.304 values between 7.30 and 7.793 values between 7.79 and 8.291 values between 8.29 and 8.791 values between 8.79 and 9.293 values between 9.29 and 9.791 values between 9.79 and 10.281 values between 10.28 and 10.782 values between 10.78 and 11.281 values between 11.28 and 11.781 values between 11.78 and 12.281 values between 12.28 and 12.781 values between 12.78 and 13.27offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. …”⏎⏎
  2. ”).
  3. …”
  4. uces
  5. ").⏎⏎
  6. ”.⏎⏎
  7. ”
  8. {}).
  9. "));⏎⏎
  10. ").

Suppresses

  1. �权
  2. >(()
  3. ([⏎
  4. ({⏎
  5. ',{⏎
  6. :[⏎
  7. |=⏎
  8. ("|
  9. 的城市
  10. فة