Neuron Explorer

Qwen3-0.6B

"the" in "the more..., the more" phrases

A neuron in layer 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the second "the" in comparison sentences like "the more data it contains, the greater its potential". When it was turned down, the model got stuck repeating the word "more" over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    is done, the company loses vital manufacturing and quality information. This information accurately collected is the only basis of implementing quality improvement. The more granular the information, the more effective it can become.⏎If the only options are in-tolerance and out

  2. #2 peak

    file names. ACTOZ is the name we shall use throughout this user's manual.⏎Actoz is a very powerful instrument. The more data it contains, the greater its potential for thorough analysis and unexpected results. One of the greatest qualities of

  3. #3 peak

    played by the unpredictable in war,” Thucydides wrote, “and think of it now, before you are actually committed. The longer a war lasts, the more things tend to depend on accidents. Neither you nor we can see into them

  4. #4 peak

    to be economic change as well.⏎“There is the plain economic truth that the more food consumers waste, the more those in the food industry are able to sell,” the report said.<|endoftext|>

  5. #5 peak

    Muslim. “Also, because of her Malay, Arabic comes easily.” Eunice adds, “And, English helps with French. The more languages you know the easier it is to learn.” According to Angela, her colleague is indeed a quick

  6. #6 peak

    it important that it be crowned and formally installed at the Shrine of Christ the King in Chicago, IL by Cardinal George? A. "The more you honor Me the more I will bless you" is the promise of the Infant King. The coron

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: more better more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more more

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    emerged as one of the most transformative technologies of our time. It encompasses machine learning, natural language processing, and computer vision, among other fields. AI systems are becoming increasingly adept at tasks that were once the sole domain of humans, from diagnosing

  2. #2 peak

    crystallography offer the opportunity to determine the atomic structure and function of biomolecules by using extremely small crystals. Betzel: “The crystals we use are getting smaller and smaller and for that reason they have to become better and more pure.

  3. #3 peak

    treatment—such as 12-step groups and other self-help programs—are free and widely available.⏎Even though many barriers remain, some encouraging signs point to treatment becoming more within reach for populations who have struggled to find recovery help in the past.⏎

  4. #4 peak

    days over 110 degrees. To save lives during extreme weather, we need air-conditioning, and lots of it. But abnormal weather, which is becoming the new normal, puts

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L15:1737 strongly suppresses
  2. L15:1129 suppresses
  3. L19:2939 excites
  4. L19:2024 excites
  5. L17:2393 suppresses
  6. L20:2321 excites
  7. L13:2045 suppresses
  8. L13:238 suppresses
  9. L16:2395 suppresses
  10. L19:1756 suppresses
  11. L21:2238 suppresses
  12. L16:2976 suppresses
  13. L18:827 excites
  14. L12:2636 suppresses
  15. L17:1962 suppresses
  16. L21:2949 suppresses comma closing 'the more X, the more Y' clauses
  17. L12:2378 excites
  18. L19:2373 excites
  19. L11:489 suppresses
  20. L21:2807 suppresses
  21. L21:2534 suppresses
  22. L21:1962 excites
  23. L15:1806 excites
  24. L8:1859 suppresses

Feeds later layers

  1. L26:551 strongly suppresses
  2. L24:847 strongly suppresses
  3. L27:1896 strongly suppresses split names and comparative stems
  4. L27:948 strongly suppresses
  5. L27:1734 suppresses
  6. L25:2908 excites
  7. L24:2350 suppresses
  8. L26:1908 suppresses
  9. L24:2554 suppresses
  10. L25:1046 weakly suppresses
  11. L23:3034 weakly suppresses
  12. L26:124 weakly excites
  13. L25:810 weakly suppresses
  14. L25:461 weakly suppresses
  15. L23:456 weakly suppresses
  16. L25:1330 weakly suppresses
  17. L26:1834 weakly suppresses
  18. L25:2011 weakly suppresses linking words like 'further' and 'worse'
  19. L27:2471 weakly suppresses
  20. L25:884 weakly suppresses
  21. L24:2021 weakly excites
  22. L23:1800 weakly excites
  23. L26:670 weakly excites
  24. L26:2514 weakly excites the word 'just' after have or has

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -20.06 and -19.401 values between -12.76 and -12.102 values between -11.43 and -10.771 values between -10.77 and -10.101 values between -10.10 and -9.442 values between -9.44 and -8.783 values between -8.78 and -8.111 values between -8.11 and -7.455 values between -7.45 and -6.798 values between -6.79 and -6.126 values between -6.12 and -5.465 values between -5.46 and -4.7911 values between -4.79 and -4.138 values between -4.13 and -3.4727 values between -3.47 and -2.8031 values between -2.80 and -2.1451 values between -2.14 and -1.47117 values between -1.47 and -0.81433 values between -0.81 and -0.152306 values between -0.15 and 0.52849 values between 0.52 and 1.1828 values between 1.18 and 1.858 values between 1.85 and 2.511 values between 3.17 and 3.841 values between 5.16 and 5.831 values between 5.83 and 6.49offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. apolis
  2. ctions
  3. extingu
  4. eing
  5. urations
  6. 愔
  7. PLETED
  8. 醐
  9. RICS
  10. ,),⏎

Suppresses

  1. 更
  2. more
  3. 更
  4. 更多
  5. more
  6. 更强
  7. 更有
  8. 更加
  9. 更多的
  10. 更大的