Neuron Explorer

Qwen3-0.6B

'de' inside Spanish names

A neuron in layer 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'de' (meaning 'of') when it sits inside a Spanish or Portuguese name, such as 'Nuestra Señora de Atocha' or 'Hombres de maíz'. Turning it up made the model write unrelated text about numbers and queues, so the steering does not show this theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    spelling), the Mayan equivalent of the Bible, which states that humans were literally created from maize, to Miguel Ángel Asturias‘ novel Hombres de maíz (Men of Maize) which is one of the best novels

  2. #2 peak

    án Cortés, and fought in the initial Spanish conquest of Mexico, but it is not clear whether his wife went with him. Some modern sources indicate that María de Estrada only arrived on the mainland in April 1520, with

  3. #3 peak

    but as the following discoveries prove, the hidden secrets of the seabed are about much more than just money.⏎Billion-dollar wreck: Nuestra Señora de Atocha⏎In July 1985, after 17

  4. #4 peak

    the Peace Corps. He created the Foundation Heart Ventures-Grupo de Ap<|endoftext|>is an elementary subatomic particle with infinitesimal mass⏎(less than

  5. #5 peak

    1934, the Franks r…⏎E-pasta adrese, uz kuru nosūtīt darba saiti:⏎Saite uz darbu:<|endoftext|>Branch of biology that groups and names organisms based on studies of

  6. #6 peak

    depending on the formed arrangement on the board between their piece and the other players' pieces (conjunction, opposition, quarter, etc.)⏎Often in this Libro de los juegos, a Table game was associated to a Chess game, through the die

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the real and a one-up of the a. s. a. f. in the s. a. h. of the 2021-11-9-1. the a. a. f. is a

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Museum of Alberta, Musée national des arts et traditions populaires, Département de l'organisation des syst

  2. #2 peak

    mourning, as in Victorian times? I noticed it during a conversation with Bernard Lestienne, a French Jesuit who works in Brazil at the Instituto Brasileiro de Desenvolvimento. He was in New York for a conference, and as

  3. #3 peak

    school's large roof generates more solar power than the school consumes, especially in the summer months and during weekends. The NPO APERe (Association pour la Promotion des Energies Renouvables) and Brussels grid operator Sibelga selected the

  4. #4 peak

    04)⏎(4) « La compression veineuse est le traitement de base des affections ve<|endoftext|>With concern over pesticide use on produce as well

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L18:72 strongly suppresses
  2. L18:550 suppresses
  3. L15:65 excites
  4. L18:2749 suppresses
  5. L8:15 suppresses unclear: mid-phrase words across many languages
  6. L18:560 excites
  7. L17:1021 excites
  8. L16:477 excites
  9. L10:39 suppresses
  10. L3:6 suppresses
  11. L15:59 excites
  12. L7:122 excites
  13. L9:453 suppresses
  14. L18:66 excites
  15. L17:35 suppresses
  16. L11:840 weakly excites
  17. L5:136 weakly suppresses
  18. L14:381 weakly suppresses
  19. L18:178 weakly excites
  20. L17:98 weakly excites
  21. L18:567 weakly excites
  22. L18:566 weakly excites
  23. L17:56 weakly excites
  24. L0:1691 weakly suppresses

Feeds later layers

  1. L20:1835 suppresses
  2. L20:2754 suppresses
  3. L20:1972 suppresses 'of' in 'of course'
  4. L20:1446 suppresses
  5. L23:1939 suppresses
  6. L25:1625 suppresses
  7. L22:1798 suppresses
  8. L21:68 suppresses
  9. L20:519 suppresses
  10. L23:1015 weakly excites
  11. L21:1420 weakly excites
  12. L21:670 weakly suppresses
  13. L20:986 weakly excites
  14. L21:1021 weakly suppresses
  15. L20:337 weakly suppresses
  16. L22:404 weakly excites
  17. L22:789 weakly excites
  18. L20:1846 weakly suppresses
  19. L24:163 weakly excites
  20. L25:994 weakly excites
  21. L20:2487 weakly suppresses
  22. L20:1991 weakly suppresses
  23. L21:2342 weakly suppresses
  24. L22:2889 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -10.51 and -10.161 values between -5.24 and -4.891 values between -4.89 and -4.541 values between -3.14 and -2.791 values between -2.79 and -2.441 values between -2.08 and -1.732 values between -1.73 and -1.383 values between -1.38 and -1.0350 values between -1.03 and -0.68399 values between -0.68 and -0.331506 values between -0.33 and 0.02987 values between 0.02 and 0.37564 values between 0.37 and 0.72319 values between 0.72 and 1.0764 values between 1.07 and 1.433 values between 1.43 and 1.781 values between 1.78 and 2.131 values between 2.13 and 2.481 values between 2.83 and 3.182 values between 3.18 and 3.53offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ⏎→→⏎
  2. uci
  3. ода
  4. те
  5. uc
  6. يا
  7. ids
  8. ⏎→⏎
  9. لع
  10. muff

Suppresses

  1. innacle
  2. 停放
  3. 买到
  4. emotion
  5. velt
  6. berman
  7. nika
  8. section
  9. resenter
  10. RowIndex