Neuron Explorer

Qwen3-0.6B

acronyms and abbreviations in brackets

A neuron in layer 24 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the start of a short form or acronym, such as the opening bracket before 'LVTS' or the 'IS' in 'ISLLC'. Turning it up made the model produce strange, repeated text, so the push itself doesn't show a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    The National Science Foundation CARE<|endoftext|>Territorial A-ZA | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S |

  2. #2 peak

    as the National Qualification for Headship (NPQH) in the United Kingdom and the (Interstate School Leaders Licensure Consortium (ISLLC) standards in the United States. Distributed patterns of leadership have developed in

  3. #3 peak

    the world competition. Therefore, some educational institutions are moving from traditional language teaching that use only the first language as the medium of instruction to content and language learning (Klippel 2003).⏎The climate of globalisation, in

  4. #4 peak

    of three concepts undergoing preliminary studies for the three-year, €7 million ($9 million) European hypersonic research project, Long Term Advanced Propulsion Concepts and Technologies (LAPCAT).⏎With €4 million from the European Commission and the rest from

  5. #5 peak

    that extends halfway out to the sun’s orbit. We know more about where the Milky Way’s spiral arms are.”⏎Named GLIMPSE360 (Galactic Legacy Mid-Plane Survey Extraordinaire project), the deep infrared survey captures only

  6. #6 peak

    clearing system.⏎- Finance Canada — Company, Canada-wide,⏎- Federal department responsible for Canada's economic performance and regulation of financial institutions.⏎- Large Value Transfer System (LVTS) — Acronym,⏎- System being created by the Canadian Payments Association

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the way in which the future is made of "riddle" and "riddle-riddle". This riddle-riddle-...riddle...hinderlly makes a way to create a non-continuous, non-ve

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    particularly influential to the founding of our country was an Englishman named John Locke (1632-1704). Locke was so influential that Thomas Jefferson listed him as one of

  2. #2 peak

    modified release (brand names include Priadel, Camcolit and Liskonium).⏎- Lithium citrate comes as a liquid and common brands include Priadel and Li-Liquid.⏎3. Who can and cannot take lithium⏎Lithium

  3. #3 peak

    the responsibility of preventing local supplies from reaching the British Army in Philadelphia.⏎Edwin Lacey was a relative of the Revolutionary War general and the son of Isaac and Ruth (nee Twining). Lacey was a tall, gaunt, red-headed

  4. #4 peak

    Latvia is de jure continuous with its declaration November 18, 1918.|⏎Latvia is a country in Northern Europe. The capital is Riga. It is one of the Baltic States, together with Estonia in the

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L22:118 strongly suppresses
  2. L23:2296 suppresses
  3. L23:674 suppresses
  4. L21:83 excites
  5. L23:2677 suppresses
  6. L23:1363 excites
  7. L23:2638 suppresses
  8. L23:2923 excites
  9. L5:565 suppresses
  10. L5:2481 weakly suppresses
  11. L21:1605 weakly suppresses
  12. L6:789 weakly excites
  13. L23:3013 weakly excites
  14. L4:1548 weakly excites
  15. L22:217 weakly excites
  16. L21:42 weakly suppresses
  17. L23:1747 weakly excites
  18. L17:739 weakly suppresses
  19. L21:2331 weakly suppresses
  20. L12:2774 weakly suppresses
  21. L11:1240 weakly suppresses
  22. L4:1312 weakly excites
  23. L12:2082 weakly excites
  24. L17:102 weakly excites

Feeds later layers

  1. L26:843 strongly excites
  2. L27:1221 strongly excites
  3. L25:763 strongly excites
  4. L27:330 strongly excites
  5. L26:882 suppresses
  6. L25:432 excites
  7. L26:2865 weakly excites
  8. L26:415 weakly suppresses
  9. L26:2355 weakly excites
  10. L27:383 weakly suppresses
  11. L27:1033 weakly suppresses
  12. L27:2025 weakly suppresses
  13. L26:2085 weakly excites
  14. L26:1423 weakly suppresses
  15. L26:1780 weakly excites
  16. L26:770 weakly excites
  17. L25:1317 weakly suppresses
  18. L27:1774 weakly suppresses
  19. L27:2685 weakly suppresses
  20. L27:2255 weakly suppresses
  21. L25:2040 weakly suppresses
  22. L26:2525 weakly suppresses
  23. L26:1509 weakly suppresses
  24. L26:2845 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -15.09 and -14.421 values between -12.38 and -11.711 values between -10.35 and -9.671 values between -8.32 and -7.642 values between -7.64 and -6.964 values between -6.96 and -6.291 values between -6.29 and -5.614 values between -5.61 and -4.935 values between -4.25 and -3.585 values between -3.58 and -2.909 values between -2.90 and -2.2219 values between -2.22 and -1.5455 values between -1.54 and -0.87994 values between -0.87 and -0.192423 values between -0.19 and 0.49231 values between 0.49 and 1.1775 values between 1.17 and 1.8534 values between 1.85 and 2.5212 values between 2.52 and 3.2012 values between 3.20 and 3.884 values between 3.88 and 4.566 values between 4.56 and 5.235 values between 5.23 and 5.911 values between 7.27 and 7.941 values between 9.30 and 9.981 values between 10.65 and 11.331 values between 11.33 and 12.01offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. L
  2. L
  3. _L
  4. (L
  5. =L
  6. ,L
  7. $L
  8. *L
  9. <L
  10. )L

Suppresses

  1. iddle
  2. 过去了
  3. elize
  4. Bounty
  5. 垠
  6. Bl
  7. 越し
  8. 问他
  9. 岁以下
  10. 력