Neuron Explorer

Qwen3-0.6B

the 'An' syllable starting a word

A neuron in layer 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the letters 'An' when they begin a longer word or name, such as Anhui, Anjou or Anuradha. When it was turned up, the model fell into repeating brackets and broken text instead of writing sentences.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    and China have projected. Bruce Fitt from the University of Hertfordshire in Hatfield, UK, and his teammates forecast levels of the disease in the Anhui and Hubei provinces from 2021-20

  2. #2 peak

    Charles II of Spain died in 1700 he bequeathed his throne and the Spanish possessions in the Netherlands, Italy and the Americas to Philip of Anjou, the grandson of King Louis XIV of France. The prospect of a

  3. #3 peak

    reference to the Roman practice of providing free wheat to Roman citizens as well as costly circus games and other forms of entertainment as a means of gaining political power. The Annona (grain dole) was begun

  4. #4 peak

    factory, which was a one-piece brass measuring 33.5 meters (109’) tall. This flagpole is still the tallest in service at Anitkabir, the mausoleum built in honor of Atatur

  5. #5 peak

    .⏎Richards’ doodle eventually made it into the hands of chemists at the University of Warwick. After several months olympicene was finally produced by Anish Mistry, from the David Fox group, using a multi-step synthesis.

  6. #6 peak

    defines a "family entity" as "a stable union between a man and a woman."2 The Catholic Church responded to the recent ruling with outrage. As Archbishop Anuar Battisti put it, the Supreme Court's decision marked a "frontal

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: The number of time it takes to read a page of 444444444444444444444444444444444444

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    postlude, or interlude, or any short instrumental work.⏎note2: Many symphonies are tonal works in four movements with the first in sonata form, which is often

  2. #2 peak

    system of the Nazi regime. Since the end of the war there has been a strong temptation to dismiss Nazism as an anti-western aberration, the exact antithesis of the values of the Enlightenment and liberal democracy. This reassuring diagnosis was

  3. #3 peak

    's blood (although we have to take two or more sample days or weeks apart and show that the RSV antibodies have increased). We can also use antigen-antibody tests to look for the virus: these tests give

  4. #4 peak

    integral part. In fact any happy occasion is seen as an excuse to imbibe in this "tonic water".⏎It is in this historical context that we, the Shirayuki

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L21:2093 suppresses
  2. L18:282 excites
  3. L20:1414 excites
  4. L17:391 excites
  5. L16:55 excites
  6. L12:2264 weakly excites
  7. L2:1923 weakly suppresses
  8. L20:1228 weakly excites
  9. L5:499 weakly excites
  10. L20:959 weakly excites
  11. L16:217 weakly excites
  12. L0:2545 weakly excites
  13. L21:2247 weakly excites
  14. L17:1082 weakly excites
  15. L7:287 weakly excites
  16. L5:1251 weakly excites
  17. L20:2206 weakly suppresses
  18. L22:1837 weakly excites
  19. L22:384 weakly suppresses
  20. L1:27 weakly excites
  21. L0:60 weakly suppresses
  22. L16:166 weakly excites
  23. L10:1490 weakly excites
  24. L0:3063 weakly suppresses

Feeds later layers

  1. L25:1700 excites
  2. L26:739 weakly suppresses
  3. L27:391 weakly suppresses
  4. L24:3051 weakly suppresses
  5. L25:2519 weakly suppresses
  6. L25:708 weakly excites
  7. L24:1571 weakly excites
  8. L24:1580 weakly excites
  9. L24:424 weakly excites
  10. L27:524 weakly excites
  11. L26:1075 weakly suppresses
  12. L25:1378 weakly excites
  13. L25:1584 weakly excites art and artist names in lists
  14. L27:884 weakly suppresses
  15. L26:1833 weakly excites
  16. L25:1154 weakly excites
  17. L24:1229 weakly excites
  18. L25:2478 weakly excites
  19. L24:770 weakly suppresses
  20. L24:196 weakly suppresses
  21. L24:2704 weakly excites
  22. L26:2368 weakly suppresses
  23. L27:1940 weakly suppresses
  24. L27:752 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -28.56 and -26.931 values between -25.29 and -23.662 values between -17.12 and -15.491 values between -13.85 and -12.222 values between -12.22 and -10.582 values between -10.58 and -8.955 values between -8.95 and -7.327 values between -7.32 and -5.6812 values between -5.68 and -4.0522 values between -4.05 and -2.4191 values between -2.41 and -0.783670 values between -0.78 and 0.8655 values between 0.86 and 2.4913 values between 2.49 and 4.1310 values between 4.13 and 5.764 values between 5.76 and 7.393 values between 7.39 and 9.032 values between 10.66 and 12.303 values between 12.30 and 13.931 values between 13.93 and 15.571 values between 35.18 and 36.81offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. h
  2. hair
  3. haft
  4. hra
  5. hm
  6. hist
  7. [
  8. hil
  9. essor
  10. hani

Suppresses

  1. pector
  2. eturn
  3. 集团股份
  4. BorderSide
  5. /display
  6. 全面发展
  7. -</
  8. arden
  9. onSelect
  10. mouseleave