Neuron Explorer

Qwen3-0.6B

letter c inside a split word

A neuron in layer 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the letter 'c' when it sits in the middle of a word that has been chopped into pieces, like 'vis-c-eral' or 'circum-c-isions'. Turning it up made the model's text fall into repeated word loops, which tells us little about what the neuron does.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    chronic pelvic pain are as follows-⏎- Central and peripheral nervous systems: Nerve damage of serious nature may occur due to anomalies in visceral functions and perceptions (visceral hyperalgesia

  2. #2 peak

    to traffic in 1880. It connected the San Miguel district to Malate and Ermita.⏎The bridge also served Isla de Convalescencia, the island in the Pasig River where the orphanage of Hospicio

  3. #3 peak

    about the Cassini-Huygens mission visit http://saturn.jpl.nasa.gov/home/index.cfm. The Cassini imaging team homepage is at http://ciclops.org.<|endoftext|>Archive for the ‘transcendental geometry’ tag

  4. #4 peak

    be an open⏎front protected by glass or a closed front faced with bronze,⏎marble, or granite. (An arrangement of niches is called a⏎c

  5. #5 peak

    Rights Reserved.|<|endoftext|>Mount Cleveland is on alert level yellow. The french blog Volcanic News Erutpion states it as being restless. http://volcansvanuatueruptionsgb.blogspot.fr/2014/0

  6. #6 peak

    we can get involved in the fight against cancer.⏎World Cancer Day -- make a difference to the fight against cancer.⏎Discover how to get engaged:http://www.worldcancerday.org<|endoftext|>There are both normal and excessive amounts of anxiety you may experience

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: whyentheententententententententententententententententententententententententententententententententententententententententententententent

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Barriers to Addiction Treatment?⏎Barriers to finding addiction treatment may vary by personal situation, but the most common barriers include:⏎- Geographic Location⏎- Co-Occurring Disorder Treatment Availability⏎

  2. #2 peak

    ی دکتری معماری منظر، دانشکده معماری و شهرسازی، دانشگاه علم و صنعت ایران، تهران، ایران.⏎عنوان

  3. #3 peak

    ⏎1 دانشیار معماری، دانشکده معماری و شهرسازی، دانشگاه علم و صنعت ایران، تهران، ایران

  4. #4 peak

    codilian species may also harbor the influenza A virus. Here we analyzed 37 captive crocodilians from two locations in Florida (plus 5 wild bird fecal samples from their habitat) to detect the presence of influenza A virus. Several

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:665 strongly suppresses
  2. L23:619 strongly excites
  3. L22:607 suppresses
  4. L18:440 excites
  5. L19:381 excites word-start 'acc' fragments
  6. L19:1853 excites
  7. L22:2898 excites
  8. L16:66 excites
  9. L0:1010 excites
  10. L0:2206 weakly excites
  11. L14:95 weakly suppresses
  12. L6:16 weakly excites
  13. L2:1661 weakly excites
  14. L21:55 weakly suppresses
  15. L16:73 weakly suppresses
  16. L0:716 weakly excites
  17. L1:2876 weakly suppresses
  18. L20:2984 weakly excites
  19. L17:2527 weakly excites
  20. L6:298 weakly suppresses
  21. L0:864 weakly excites
  22. L16:719 weakly excites
  23. L22:1155 weakly suppresses
  24. L16:524 weakly excites

Feeds later layers

None: this is the last layer.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -35.50 and -32.101 values between -28.69 and -25.291 values between -25.29 and -21.881 values between -21.88 and -18.482 values between -18.48 and -15.071 values between -8.26 and -4.869 values between -4.86 and -1.453881 values between -1.45 and 1.954 values between 1.95 and 5.361 values between 5.36 and 8.762 values between 12.17 and 15.571 values between 25.78 and 29.191 values between 39.40 and 42.811 values between 56.43 and 59.831 values between 97.28 and 100.69offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 横
  2. 箍
  3. eni
  4. 公益性
  5. GENCY
  6. xia
  7. 体
  8. 扫
  9. 楼层
  10. sag

Suppresses

  1. ent
  2. lor
  3. cccc
  4. lin
  5. ur
  6. lac
  7. lon
  8. over
  9. ombine
  10. lm