Neuron Explorer

Qwen3-0.6B

comma between a place and its region

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the comma that comes right after a town or city name and before its state, county or country, as in 'Williamstown, Massachusetts' or 'Swindon, Wiltshire'. Turning it down made the model repeat the word 'John', but the steering results do not show a clear theme beyond that.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    iana Cavendish, 1787. Mezzotint and engraving on paper. © Sterling and Francine Clark Art Institute, Williamstown, Massachusetts. Acquired by Sterling and Francine Clark, 1943

  2. #2 peak

    ⏎© Copyright 2013 - 2017 WHSmith and its suppliers.⏎WHSmith High Street Limited Greenbridge Road, Swindon, Wiltshire, United Kingdom, SN3 3

  3. #3 peak

    arium ear blight’ (FEB), scientists in the UK and China have projected. Bruce Fitt from the University of Hertfordshire in Hatfield, UK, and his teammates forecast levels of the disease in the Anhui and

  4. #4 peak

    ized times|⏎|Editors||Kerry John KENNEDY, Chi Kin John LEE|⏎|Place of Publication||Abingdon, Oxon|⏎|Publication status||E-pub ahead of print - Aug

  5. #5 peak

    . Then they create their own monument to honor a...⏎Birthplace: Shadwell, Albemarle County, VirginiaReligion: Christian (no specific denomination)

  6. #6 peak

    45 mya: Denmark=Bornholm.⏎- Cretaceous/145-65 mya: U.S.A.=Maryland, Massachusetts, New Jersey, New York,⏎Delaware, North Carolina, Tennessee, Arkansas,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John John

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    finance restrictions.⏎In 1979 Time magazine characterized NCPAC, the Conservative Caucus and the Committee for the Survival of a Free Congress (headed by Paul Weyrich) as the three most important ultraconservative organizations making up the

  2. #2 peak

    )⏎The two Supreme Court cases, Jones v. City of Opelika 316 U.S. 584 (1942) and 319 U.S. 103 (1943

  3. #3 peak

    ister (1994/2005). Eddington's Search for a Fundamental Theory: A Key to the Universe. Cambridge University Press.⏎Paul M. Clark (

  4. #4 peak

    , President Abraham Lincoln and Confederate Vice President Alexander H. Stephens held a shipboard peace conference off the Virginia coast; the talks

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:551 strongly excites
  2. L10:1278 strongly excites
  3. L20:1377 strongly excites
  4. L10:1293 strongly suppresses
  5. L10:556 suppresses
  6. L17:1095 suppresses
  7. L19:1333 suppresses
  8. L9:789 suppresses
  9. L3:159 excites
  10. L24:456 excites
  11. L9:2482 excites
  12. L16:1300 suppresses
  13. L22:1171 excites
  14. L23:276 suppresses
  15. L21:472 excites
  16. L9:453 excites
  17. L8:514 excites
  18. L4:236 suppresses
  19. L9:1293 excites
  20. L19:749 suppresses
  21. L14:1614 excites
  22. L18:560 suppresses
  23. L9:1386 excites
  24. L23:1871 excites

Feeds later layers

  1. L27:1130 suppresses
  2. L27:2048 suppresses
  3. L27:784 suppresses
  4. L27:634 weakly suppresses
  5. L27:93 weakly suppresses
  6. L27:1955 weakly suppresses
  7. L27:1358 weakly suppresses
  8. L27:2458 weakly suppresses
  9. L27:1201 weakly suppresses
  10. L27:892 weakly suppresses
  11. L27:2922 weakly suppresses
  12. L27:1891 weakly excites
  13. L27:670 weakly suppresses
  14. L27:2833 weakly excites
  15. L27:2537 weakly suppresses
  16. L27:1758 weakly excites
  17. L27:2193 weakly excites
  18. L27:1566 weakly suppresses
  19. L27:1813 weakly suppresses
  20. L27:2058 weakly suppresses
  21. L27:2727 weakly suppresses
  22. L27:1305 weakly excites
  23. L27:1002 weakly excites
  24. L27:937 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -36.31 and -34.453 values between -27.01 and -25.152 values between -25.15 and -23.293 values between -23.29 and -21.437 values between -21.43 and -19.578 values between -19.57 and -17.7113 values between -17.71 and -15.8522 values between -15.85 and -13.9942 values between -13.99 and -12.1362 values between -12.13 and -10.2795 values between -10.27 and -8.41163 values between -8.41 and -6.55329 values between -6.55 and -4.69538 values between -4.69 and -2.83936 values between -2.83 and -0.971392 values between -0.97 and 0.89173 values between 0.89 and 2.7538 values between 2.75 and 4.6129 values between 4.61 and 6.4717 values between 6.47 and 8.339 values between 8.33 and 10.197 values between 10.19 and 12.055 values between 12.05 and 13.914 values between 13.91 and 15.772 values between 15.77 and 17.631 values between 17.63 and 19.491 values between 19.49 and 21.351 values between 21.35 and 23.211 values between 23.21 and 25.071 values between 25.07 and 26.931 values between 28.79 and 30.651 values between 30.65 and 32.511 values between 36.23 and 38.09offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 平整
  2. OPTIONAL
  3. olynomial
  4. ctors
  5. ppe
  6. _activ
  7. oppon
  8. alars
  9. 꽃
  10. нце

Suppresses

  1. 詹姆斯
  2. 纽约
  3. 伦敦
  4. 在美国
  5. 爱尔兰
  6. John
  7. John
  8. 美國
  9. Johnson
  10. 芝加哥