Neuron Explorer

Qwen3-0.6B

music and art genre words

A neuron in layer 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on words in music and art writing, like opera, jazz, concertos, Bach's and Haydn's. It seems tied to talk about classical and jazz music. Turning it up pushed the model toward the word 'score' and repetition, so the effect is only partly clear.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    ’s nocturnes, Bach’s preludes and fugues, and the works of Clementi, Mozart and

  2. #2 peak

    weights that work various bits of scenery.⏎In the 18th century, opera's popularity spread to England. One of the first Italian-language operas to be written for the London stage was George Frideric Handel's

  3. #3 peak

    , Edward Kennedy Ellington undertook this task in composing the multi-movement jazz suite Black, Brown, and Beige. Originally debuted at Carnegie Hall on January

  4. #4 peak

    the mini essay completed in July OR starting afresh, write a detailed report about use of harmony in Haydn’s Joke quartet. Start with the sentence ‘Like the Corelli, the harmony

  5. #5 peak

    performance could be what made or broke a musician's career, leading to new performing opportunities and patrons.⏎Yet, despite the large number of women who wrote and performed concertos (often early life), these life-altering opportunities were often denied to them

  6. #6 peak

    as celebrating its key stars and performances.⏎Opera evolved from grand-scale spectacles held in royal palaces during the 17th century. Our collections contain several engravings featuring the Palace of Versailles, where Louis XIV regularly held lavish performances

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: UUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUU

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    out, short, stout legs, and heavy claws are well suited for digging and burrowing. Armadillos have a limited number of vocalizations: a low, wheezy grunt associated with digging and rooting; a wheezy grunt uttered

  2. #2 peak

    a drummer for most jazz, country and western, rhythm and blues, and rock and roll bands. A drum set generally features at minimum, one snare, two toms, a base drum and a high hat or symbol. This combination is

  3. #3 peak

    at the University of New Mexico. Troy L. Best is a professor of biological sciences at Auburn University.<|endoftext|>Snare drums are a type of drum that makes a distinct cracking sound when hit with a drumstick. They are also the type of

  4. #4 peak

    and unpaired structures originating in the pharynx and serving to amplify sound (vocal sacs); (3) sacs that branch off from the widened posterior

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L22:2462 suppresses
  2. L21:1829 suppresses
  3. L20:2050 excites
  4. L6:1864 excites
  5. L23:2396 suppresses
  6. L6:2484 excites
  7. L3:2441 excites
  8. L23:2146 weakly suppresses
  9. L3:996 weakly suppresses
  10. L20:2828 weakly suppresses
  11. L6:2787 weakly suppresses
  12. L6:1914 weakly excites
  13. L3:993 weakly suppresses
  14. L4:2098 weakly suppresses
  15. L22:1850 weakly suppresses
  16. L15:1858 weakly excites
  17. L0:421 weakly excites
  18. L23:1003 weakly excites
  19. L19:1847 weakly excites
  20. L24:279 weakly suppresses
  21. L9:1764 weakly excites
  22. L3:1643 weakly excites
  23. L17:260 weakly excites commas mid-sentence before a continuation
  24. L4:43 weakly excites

Feeds later layers

  1. L26:2498 weakly excites
  2. L26:2567 weakly suppresses
  3. L27:636 weakly suppresses
  4. L26:1209 weakly suppresses
  5. L27:2614 weakly suppresses
  6. L27:2526 weakly excites
  7. L27:2770 weakly excites
  8. L26:1155 weakly excites
  9. L27:2137 weakly suppresses
  10. L26:1591 weakly suppresses
  11. L26:1918 weakly excites
  12. L27:662 weakly suppresses
  13. L27:2638 weakly suppresses
  14. L27:2961 weakly suppresses
  15. L27:111 weakly excites
  16. L26:324 weakly excites
  17. L26:843 weakly excites
  18. L27:2600 weakly suppresses
  19. L27:1577 weakly suppresses
  20. L27:2793 weakly suppresses
  21. L26:2754 weakly suppresses
  22. L26:2290 weakly suppresses
  23. L27:1297 weakly suppresses
  24. L26:2863 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -30.95 and -29.571 values between -19.88 and -18.502 values between -18.50 and -17.111 values between -14.35 and -12.962 values between -12.96 and -11.581 values between -8.81 and -7.433 values between -7.43 and -6.047 values between -6.04 and -4.6613 values between -4.66 and -3.2719 values between -3.27 and -1.89301 values between -1.89 and -0.513431 values between -0.51 and 0.8871 values between 0.88 and 2.2622 values between 2.26 and 3.6512 values between 3.65 and 5.037 values between 5.03 and 6.413 values between 6.41 and 7.803 values between 7.80 and 9.182 values between 9.18 and 10.571 values between 10.57 and 11.952 values between 13.33 and 14.721 values between 14.72 and 16.101 values between 17.49 and 18.871 values between 23.02 and 24.41offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. score
  2. aticon
  3. Score
  4. icles
  5. SCORE
  6. icle
  7. rega
  8. (score
  9. Score
  10. _score

Suppresses

  1. U
  2. suất
  3. 婆
  4. UA
  5. 动
  6. prostitutes
  7. din
  8. subtype
  9. 悦
  10. UA