Neuron Explorer

Qwen3-0.6B

unclear: word pieces inside names

A neuron in layer 1 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a piece of a word or name, such as the 'State' in 'Penn State' or the 'acin' in 'niacin'. It is hard to find a single theme, and turning it up did not produce a clear change in what the model wrote.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Add your thoughts below. You can sign in with Google, Twitter, Facebook, Yahoo! to get your story posted straight away - or just post a comment to be published later.⏎Let us help you plan

  2. #2 peak

    health is that severe deficiency of certain vitamins can lead to well-known diseases such as:⏎- Rickets caused by vitamin D deficiency⏎- Pellagra caused by niacin deficiency⏎- Scurvy caused by vitamin C deficiency⏎- Beriberi

  3. #3 peak

    drive to the nearest health clinic to visit a doctor. In rural South Africa, it is often times more practical for the care to come to the patient. Penn State engineering students work in South Africa to bring improvements to these mobile medical clinics.⏎This

  4. #4 peak

    14, mostly due to the fact that the United States and the Ottoman Empire had chosen opposite fronts in the doom of World War I.⏎A Turk named Yunus Yaşo, who did not want to be buried in a Christian cemetery, opened

  5. #5 peak

    the forests of Pennsylvania as “the natural produce of the country.” Consider using native trees in yards to preserve our habitats.⏎For additional assistance, contact your local Penn State Master Gardeners or local Native Plant Society.⏎Return to Pest Pages⏎Gypsy

  6. #6 peak

    Egg-hatching season is here, and that has some people on edge,” said Emelie Swackhamer, a horticulture educator with Penn State Extension. She added that the pest now has been reported in 3

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have a 3D modeler and a 3D modeler who has created a model to simulate the motion of the world. I have to get a 3D modeler to simulate the motion of the world. I have

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    by the Young Men's Republican Union.⏎To some it seemed a strange invitation; Peter Cooper had served as a Jacksonian Democrat on the New York Board of Alderman. But he was also an ardent enemy of slavery and he was glad to

  2. #2 peak

    , he made sounds similar to that of a horse (ashwa). Hence he was named as Ashwathama. Drona always had a soft corner for his son. Dron

  3. #3 peak

    una in archery, Bhima and Duryodhana in fighting with mace and so on.⏎Dronacharya had a son by name Ashwathama. When Ashwathama was born

  4. #4 peak

    invoked His divine weapon, the Sudarshana Chakra. It immediately appeared in front of Him in all its brilliant lustre. Krishna then asked Ashwathama to lift the Chakra and take with him if he could.⏎Ashw

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:178 suppresses
  2. L0:1224 suppresses
  3. L0:1301 suppresses
  4. L0:1 suppresses
  5. L0:1329 weakly suppresses
  6. L0:201 weakly excites
  7. L0:2146 weakly excites
  8. L0:868 weakly excites
  9. L0:2201 weakly suppresses
  10. L0:1670 weakly excites
  11. L0:77 weakly excites
  12. L0:2995 weakly suppresses
  13. L0:1622 weakly suppresses
  14. L0:319 weakly excites blank space after a label colon
  15. L0:2259 weakly suppresses
  16. L0:1565 weakly suppresses
  17. L0:571 weakly excites
  18. L0:1075 weakly excites
  19. L0:1161 weakly excites
  20. L0:2599 weakly suppresses
  21. L0:799 weakly suppresses
  22. L0:1461 weakly suppresses
  23. L0:2189 weakly excites
  24. L0:1497 weakly excites

Feeds later layers

  1. L22:1463 weakly suppresses
  2. L5:2145 weakly suppresses
  3. L23:2451 weakly suppresses
  4. L17:1594 weakly excites
  5. L17:491 weakly excites
  6. L6:876 weakly excites
  7. L6:1671 weakly excites
  8. L24:1016 weakly suppresses
  9. L23:2829 weakly excites
  10. L13:931 weakly suppresses
  11. L17:627 weakly excites
  12. L22:505 weakly excites
  13. L2:398 weakly suppresses
  14. L3:2634 weakly excites
  15. L23:299 weakly suppresses
  16. L22:1369 weakly excites
  17. L10:411 weakly excites
  18. L23:239 weakly suppresses
  19. L6:257 weakly excites
  20. L9:1404 weakly excites
  21. L8:605 weakly excites
  22. L23:1012 weakly suppresses
  23. L12:1354 weakly excites
  24. L3:2897 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.39 and -2.321 values between -1.54 and -1.478 values between -0.35 and -0.2827 values between -0.28 and -0.21108 values between -0.21 and -0.14365 values between -0.14 and -0.071505 values between -0.07 and 0.001470 values between 0.00 and 0.07303 values between 0.07 and 0.1579 values between 0.15 and 0.2228 values between 0.22 and 0.2910 values between 0.29 and 0.363 values between 0.36 and 0.43offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. umber
  2. ثن
  3. ZN
  4. 批
  5. SY
  6. glam
  7. ICH
  8. ST
  9. reck
  10. 特殊情况

Suppresses

  1. IVITY
  2. odia
  3. peria
  4. pagina
  5. onas
  6. 的压力
  7. PRESSION
  8. imulation
  9. haar
  10. pressed