Neuron Explorer

Qwen3-0.6B

comma before 'but' in contrasts

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the comma that comes just before a 'but' in phrases like 'not only X, but also Y'. Turning it down made the model repeat the word 'but' over and over, which fits the word it helps set up.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    's used to treat mood disorders such as:⏎- mania (feeling highly excited, overactive or distracted)⏎- hypo-mania (similar to mania, but less severe)⏎- regular periods of depression, where treatment with other medicines has

  2. #2 peak

    5 minutes)⏎Today we will learn that prayer is communicating or talking with God. We may not be able to call God on the telephone or send Him a letter, but prayer is just as real as e-mail or newspapers. Why should we pray

  3. #3 peak

    are not properly maintained, your home will not only feel very uncomfortable to live in, but you and your family may also become susceptible to respiratory disorders or chemical reactions.⏎

  4. #4 peak

    iveness while living in a Christian world. It will be suggested that Mudejar self-perception and group-perception were founded not only on religious belief per se, but also on⏎the perpetuation of a social world the organization and mores

  5. #5 peak

    a time of preparation for Easter. From the church’s earliest days, the resurrection of Christ was celebrated not only each week (on Sunday, the Lord’s Day), but also in a special festival of the resurrection. This festival we call Easter Day

  6. #6 peak

    due to the corrupted values popularized by the American Dream.⏎Ultimately, Tom is quite saddened by Myrtle’s death, not because he loved her as a person, but because he loved having control over her. Now that she is dead, Tom

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: but but but but but but but but but but but but but but but but but but but but but but but but but可可可可可可可可可可可可可可可可可可可可可可可

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    1949, the right to asylum was laid down in the Constitution. Until 1993, Article 16 of the Constitution (Grundgesetz)

  2. #2 peak

    new era of hope. Martin Luther King Jr. led the civil rights movement to new heights, ultimately leading to the signing of the “Civil Rights Act” of 1964. The whole world watched in awe and amazement as

  3. #3 peak

    the other molecule. Hence such an arrangement provides denser packing than one possessing mirror planes. Lucretius over 2000 years ago proclaimed in his De rerum natura :⏎“Things whose fabrics show opposites that match,⏎one

  4. #4 peak

    168 note) who remarks: — "Um dies (i.e. Varro's description of the extent of Roma quadrata) mit dem unten erörterten Pomerium und der Auffassung des Dionys.

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L21:478 strongly suppresses
  2. L20:1764 strongly suppresses
  3. L20:1194 strongly suppresses
  4. L19:2294 strongly suppresses
  5. L17:2269 strongly excites
  6. L20:1309 strongly excites
  7. L16:788 strongly excites
  8. L15:343 strongly excites
  9. L19:3030 strongly suppresses
  10. L15:844 strongly suppresses unclear: verbs in health and risk claims
  11. L24:2282 strongly excites
  12. L16:2778 strongly suppresses
  13. L15:2976 suppresses
  14. L17:762 excites
  15. L16:2865 suppresses
  16. L16:2373 suppresses
  17. L14:2135 excites
  18. L17:2817 suppresses
  19. L14:1903 suppresses
  20. L14:2480 suppresses
  21. L15:2542 suppresses
  22. L18:2396 suppresses
  23. L14:1531 excites
  24. L14:2809 excites

Feeds later layers

  1. L27:568 strongly suppresses
  2. L26:1232 strongly suppresses
  3. L27:1084 strongly suppresses
  4. L27:2009 suppresses
  5. L27:760 suppresses
  6. L27:1698 weakly suppresses
  7. L26:190 weakly suppresses
  8. L27:1088 weakly suppresses
  9. L26:157 weakly excites
  10. L26:83 weakly excites
  11. L26:1723 weakly suppresses
  12. L26:836 weakly excites
  13. L27:245 weakly excites
  14. L27:1678 weakly excites
  15. L27:2951 weakly excites
  16. L27:789 weakly suppresses
  17. L27:1104 weakly excites
  18. L27:2228 weakly excites
  19. L27:2651 weakly suppresses
  20. L27:1491 weakly suppresses
  21. L26:275 weakly suppresses
  22. L26:347 weakly suppresses the 're' in self-reliant and similar
  23. L26:456 weakly excites
  24. L27:601 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -15.23 and -14.221 values between -10.17 and -9.163 values between -9.16 and -8.146 values between -8.14 and -7.139 values between -7.13 and -6.1215 values between -6.12 and -5.1018 values between -5.10 and -4.0949 values between -4.09 and -3.08121 values between -3.08 and -2.06319 values between -2.06 and -1.051192 values between -1.05 and -0.041980 values between -0.04 and 0.98106 values between 0.98 and 1.9928 values between 1.99 and 3.0121 values between 3.01 and 4.0210 values between 4.02 and 5.039 values between 5.03 and 6.056 values between 6.05 and 7.062 values between 7.06 and 8.071 values between 8.07 and 9.082 values between 9.08 and 10.101 values between 10.10 and 11.111 values between 12.12 and 13.142 values between 14.15 and 15.161 values between 15.16 and 16.181 values between 16.18 and 17.191 values between 18.20 and 19.221 values between 21.24 and 22.261 values between 24.28 and 25.30offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. TimeUnit
  2. ends
  3. oud
  4. htag
  5. zept
  6. ActionResult
  7. @\
  8. ​​
  9. CellValue
  10. остью

Suppresses

  1. 但
  2. but
  3. but
  4. 但是
  5. 然而
  6. though
  7. 但我
  8. 但在
  9. however
  10. However