Neuron Explorer

Qwen3-0.6B

unclear: document ends and number gaps

A neuron in layer 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron is hard to pin down. It fires most on the end-of-text marker between documents, and it goes quiet on the gap right before a second year or number, such as in '1989 and [blank] 1996'. Turning it up or down changed the writing in ways that did not show a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    ' labour in a portfolio with him and rather than let the research fall into German hands, (Poland having been invaded by Germany), he has hidden it.<|endoftext|>BURKE TEACHERS STUDY, PREPARE FOR NEW CURRICUL

  2. #2 peak

    major avoidable risk factors.<|endoftext|>As the rain begins to fall on Tanzania’s Tarangire National Park, thousands

  3. #3 peak

    days.<|endoftext|>The bread glycemic index enables health conscious people to choose the right bread for the

  4. #4 peak

    Project:<|endoftext|>After years of experience and "combing through" catalogs⏎to find the best

  5. #5 peak

    software applications use 255 file type for internal purposes and/or also by different way than common edit or open 255 file actions.<|endoftext|>The Importance of Detoxification – Part 1⏎Updated: Sep 2

  6. #6 peak

    code<|endoftext|>Jet engines, or gas turbines, suck in air at the front with a fan

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the, the,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    findings noted above, based on research by Dr. Michael J. Murray and his associates, were published in Equine Veterinary Journal in 1989 and 1996. An even more recent study in 2005

  2. #2 peak

    William R. Pogue orbited the Earth for 84 days during the final manned flight of the Skylab space station in 1973 and 1974.⏎He was born January 23, 19

  3. #3 peak

    55°W and 35°N and 42°N. The patch extends over an indeterminate area, with estimates

  4. #4 peak

    对比分析的研究成果对泰国学生学习汉语助动词具有较大的帮助,学生能更容易、更好地把握汉语助动词的语义、语法功能与特点。auxiliary verbs have very important functions in Chinese grammar. They are frequently

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L13:1578 suppresses
  2. L6:101 suppresses
  3. L7:874 suppresses
  4. L8:410 excites
  5. L13:44 suppresses inside web addresses and citations
  6. L10:155 excites
  7. L6:1801 excites
  8. L14:375 suppresses
  9. L6:2477 weakly suppresses
  10. L11:1602 weakly excites
  11. L14:775 weakly suppresses
  12. L7:111 weakly suppresses
  13. L14:282 weakly excites
  14. L8:328 weakly excites
  15. L11:226 weakly suppresses
  16. L6:1233 weakly suppresses
  17. L4:96 weakly suppresses
  18. L0:68 weakly excites
  19. L8:81 weakly excites
  20. L10:289 weakly suppresses
  21. L14:37 weakly excites
  22. L7:6 weakly suppresses
  23. L10:356 weakly suppresses
  24. L8:93 weakly excites period after a middle initial

Feeds later layers

  1. L16:1112 excites
  2. L16:1993 excites
  3. L16:1059 excites
  4. L20:2998 excites
  5. L16:775 excites
  6. L18:1249 excites
  7. L20:302 suppresses
  8. L18:166 excites
  9. L19:376 suppresses
  10. L17:839 excites
  11. L18:1775 excites
  12. L19:2073 excites
  13. L17:585 weakly excites
  14. L24:35 weakly suppresses
  15. L19:386 weakly suppresses
  16. L17:1997 weakly excites
  17. L16:1315 weakly excites word or phrase being named or defined
  18. L19:2335 weakly excites
  19. L17:1772 weakly excites
  20. L18:227 weakly suppresses
  21. L19:730 weakly suppresses
  22. L17:219 weakly excites
  23. L19:1767 weakly excites
  24. L16:797 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.94 and -2.713 values between -2.71 and -2.482 values between -2.48 and -2.251 values between -2.25 and -2.024 values between -2.02 and -1.792 values between -1.79 and -1.564 values between -1.56 and -1.3310 values between -1.33 and -1.119 values between -1.11 and -0.8819 values between -0.88 and -0.6552 values between -0.65 and -0.42416 values between -0.42 and -0.192002 values between -0.19 and 0.04918 values between 0.04 and 0.27223 values between 0.27 and 0.50109 values between 0.50 and 0.7367 values between 0.73 and 0.9639 values between 0.96 and 1.1914 values between 1.19 and 1.422 values between 1.42 and 1.655 values between 1.65 and 1.881 values between 1.88 and 2.111 values between 2.34 and 2.571 values between 2.57 and 2.801 values between 3.03 and 3.261 values between 3.26 and 3.491 values between 6.01 and 6.24offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 这才
  2. SpaceItem
  3. 就是为了
  4. );\
  5. overwhel
  6. avanaugh
  7. %;">
  8. ");⏎⏎⏎
  9. 这就是
  10. apk

Suppresses

  1. ستمرار
  2. Torch
  3. 台
  4. ться
  5. ames
  6. unts
  7. ,
  8. Lib
  9. minimum
  10. lice