Neuron Explorer

Qwen3-0.6B

end-of-document boundary token

A neuron in layer 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the invisible marker the training text uses to show that one web page has ended and another has begun. It is only weakly active, and turning it up or down mostly made the model's output messy or full of asterisks.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    and improve communication will get them ready for job interviews. Long-term tracking, counselling, and support will be<|endoftext|>In this video, students learn that the Exxon Valdez oil spill in Alaska in

  2. #2 peak

    Engineering Career Development, check this out: http://engineeringcareercoach.com/community/⏎We would love to hear<|endoftext|>from The American Heritage® Dictionary of the English Language, 4th Edition⏎

  3. #3 peak

    utf8mb4) bytes per character can be used. So if one specifies VARCHAR(50) CHARSET utf8mb4, …[Read more]<|endoftext|>To actually reduce pounds in a healthier manner, it is perfect to burn fat gradually

  4. #4 peak

    measures for tobacco control in the Region based on the provisions of the Convention. The Meeting of the Advisory Committee (ACM), held at WHO/SEARO<|endoftext|>A finely modelled Ancient Roman cast bronze all-round statuette in the form

  5. #5 peak

    ⏎July 08, 2009 |<|endoftext|>Computer Science Concentration for Students Matriculated After Jan. 1,

  6. #6 peak

    and resource for Scrabble & Words With Friends players.<|endoftext|>The Aioi Bridge is a T-shaped bridge that was originally targeted by American

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: **** ***** **** **** **** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** ** **

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    |⏎Koothus in Silapathikaram⏎by Subashini Pathmanathan⏎Ancient Tamils called their dances by

  2. #2 peak

    Coahuila y Nuevo León, Cuartel General en Monterey, Enero 3 de 1841, broadside, photostat.⏎3. Mariano Arista<|endoftext|>Dating photos relies on a combination of:⏎-

  3. #3 peak

    ментарии при наличии в них нецензурной брани, оскорблений или спама<|endoftext|>Conflict and Solidarity in Mudejar Society⏎The activity of the industrious

  4. #4 peak

    презентации Презентация london-history-1216214947983326-8 по слайдам⏎2008 by Mag. Andreas Hofer and the 4 DHW

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L17:1340 excites
  2. L17:1176 suppresses
  3. L15:65 excites
  4. L2:49 suppresses
  5. L5:78 weakly suppresses
  6. L2:2439 weakly suppresses
  7. L2:549 weakly suppresses
  8. L2:70 weakly excites
  9. L5:158 weakly suppresses
  10. L1:2233 weakly excites
  11. L17:954 weakly excites
  12. L17:581 weakly excites
  13. L5:169 weakly excites
  14. L5:110 weakly suppresses
  15. L16:270 weakly excites
  16. L11:131 weakly excites
  17. L1:2261 weakly suppresses
  18. L8:453 weakly suppresses
  19. L12:2728 weakly suppresses
  20. L17:1568 weakly suppresses
  21. L12:1818 weakly excites
  22. L16:1297 weakly excites unclear: document ends and answer colons
  23. L17:247 weakly suppresses
  24. L13:1174 weakly suppresses

Feeds later layers

  1. L26:156 strongly excites
  2. L24:96 strongly suppresses
  3. L24:303 strongly excites
  4. L23:194 strongly suppresses
  5. L26:288 strongly excites
  6. L26:16 strongly suppresses
  7. L25:207 strongly excites
  8. L21:1150 strongly excites
  9. L22:261 strongly excites
  10. L19:2077 suppresses
  11. L25:1274 excites
  12. L26:1180 excites
  13. L27:136 excites
  14. L27:179 suppresses
  15. L19:1105 excites
  16. L26:133 excites
  17. L27:445 excites
  18. L20:561 excites end of document marker
  19. L27:256 suppresses
  20. L25:144 suppresses
  21. L22:734 suppresses
  22. L27:1065 excites
  23. L26:640 suppresses
  24. L27:309 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.60 and -2.472 values between -1.74 and -1.614 values between -0.63 and -0.511 values between -0.51 and -0.3822 values between -0.38 and -0.2680 values between -0.26 and -0.14320 values between -0.14 and -0.012122 values between -0.01 and 0.11806 values between 0.11 and 0.23265 values between 0.23 and 0.36130 values between 0.36 and 0.4851 values between 0.48 and 0.6024 values between 0.60 and 0.7310 values between 0.73 and 0.8511 values between 0.85 and 0.979 values between 0.97 and 1.096 values between 1.09 and 1.226 values between 1.22 and 1.349 values between 1.34 and 1.464 values between 1.46 and 1.597 values between 1.59 and 1.715 values between 1.71 and 1.832 values between 1.83 and 1.966 values between 1.96 and 2.083 values between 2.08 and 2.202 values between 2.20 and 2.32offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ('');⏎⏎
  2. ("");⏎⏎
  3. !⏎⏎
  4. ''⏎⏎
  5. ;⏎⏎
  6. '';⏎⏎
  7. [];⏎⏎
  8. ();⏎⏎
  9. !)⏎⏎
  10. <>();⏎⏎

Suppresses

  1. **⏎
  2. **⏎
  3. ****⏎
  4. **
  5. |⏎
  6. **
  7. *⏎
  8. *⏎
  9. |⏎
  10. .*⏎