Neuron Explorer

Qwen3-0.6B

'is' right after 'there'

A neuron in layer 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'is' when it comes straight after 'There', as in 'There is a high demand'. Turning it up made the model's text wander into vague, general statements, but the link to 'there is' is only visible in the examples.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    the fifth most commonly spoken native language in the world.⏎- Arabic is the liturgical language of Islam.⏎- There is a high demand and low supply of Arabic-speakers in the Western World.⏎-

  2. #2 peak

    to enhance their appearance.⏎Only a few gemstones that are called organic come from plants and animals. These gemstones are amber, ivory, and pearl. There is a category of gemstones known as plastic. They do not come from nature and

  3. #3 peak

    ethnocentrism, consumer ethnocentrism is specific to consumers of a particular country. Ethnocentrism refers to general groups of people, wherein there is an "in-group" and an "out-group." In terms of consumer eth

  4. #4 peak

    Apples are beneficial in Diabetes⏎Apple are very effective in the treatment of diabetes. Apples contain a rich, natural therapeutic substance called pectin. There is p

  5. #5 peak

    are displayed here.<|endoftext|>Epigenetics is the study of changes in the regulation of gene activity and expression that are not dependent on alterations in gene sequence. There is a rapidly growing realization that complex diseases ranging from asthma, diabetes, addiction, schizophrenia

  6. #6 peak

    , such as through CT scans, MRI, X-rays, ultrasound, or nuclear tests like the Positron Emission Tomography (PET) Scan. There is also imaging that is used to see parts of the body that are undetectable

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: If you are, for example, a member of the U.S. government, then you are free to... (but not restricted) by the U.S. government. What does this mean? Now, I have been thinking about it,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Aetna) is an active stratovolcano on the east coast of Sicily, close to Messina and Catania. It lies above the convergent plate margin between the African Plate and the Eurasian Plate. It is the tallest

  2. #2 peak

    Contentment⏎Shakespeare’s play Richard III, Act-I, Scene-I, Lines 1-4, begins with the following famous stanza:⏎“Now is the winter of our discontent⏎Made glorious summer by this son of York;⏎And all

  3. #3 peak

    and where to look.⏎The Space Station orbits Earth about 15 times per day. With your unaided eyes, it looks like a bright star moving across the sky. But it doesn’t blink like an airplane.⏎To find out when

  4. #4 peak

    few weeks longer for some cats, but most kittens will have their baby teeth out by the 8th week.⏎Check; does your kitten have all of his temporary teeth out yet? He is probably around 8 to 10 weeks of

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L5:2153 suppresses
  2. L5:1094 suppresses
  3. L4:341 weakly suppresses
  4. L7:1760 weakly suppresses
  5. L4:1579 weakly excites
  6. L8:1632 weakly excites
  7. L6:1849 weakly excites
  8. L8:1023 weakly excites
  9. L4:636 weakly suppresses
  10. L3:2984 weakly excites unclear: mid-word subword pieces
  11. L8:1300 weakly excites
  12. L7:2921 weakly excites
  13. L8:2008 weakly suppresses
  14. L6:5 weakly excites
  15. L0:689 weakly suppresses
  16. L7:1691 weakly suppresses
  17. L1:2622 weakly suppresses
  18. L3:544 weakly suppresses opening parenthesis in lists and asides
  19. L1:2600 weakly suppresses
  20. L5:766 weakly suppresses
  21. L3:216 weakly suppresses empty slot before a figure number
  22. L3:1382 weakly suppresses
  23. L8:827 weakly excites
  24. L4:1418 weakly excites

Feeds later layers

  1. L16:2913 excites
  2. L20:1404 excites
  3. L17:938 excites
  4. L11:1528 suppresses
  5. L11:773 excites
  6. L16:2448 excites
  7. L11:979 excites
  8. L14:534 suppresses
  9. L25:1994 weakly excites
  10. L21:2458 weakly excites
  11. L19:1983 weakly excites
  12. L20:2682 weakly excites
  13. L13:1732 weakly excites
  14. L21:1222 weakly excites
  15. L21:732 weakly excites
  16. L11:1962 weakly excites
  17. L17:2820 weakly excites
  18. L16:1099 weakly suppresses
  19. L20:2326 weakly excites
  20. L14:1845 weakly suppresses
  21. L10:728 weakly suppresses
  22. L12:534 weakly suppresses
  23. L26:2817 weakly excites
  24. L24:2131 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.57 and -1.422 values between -1.42 and -1.271 values between -1.11 and -0.964 values between -0.96 and -0.816 values between -0.81 and -0.6612 values between -0.66 and -0.5147 values between -0.51 and -0.35311 values between -0.35 and -0.201189 values between -0.20 and -0.051848 values between -0.05 and 0.10335 values between 0.10 and 0.2672 values between 0.26 and 0.4133 values between 0.41 and 0.5613 values between 0.56 and 0.718 values between 0.71 and 0.8610 values between 0.86 and 1.022 values between 1.02 and 1.174 values between 1.32 and 1.473 values between 1.47 and 1.631 values between 1.63 and 1.782 values between 1.93 and 2.081 values between 2.54 and 2.691 values between 3.45 and 3.601 values between 4.21 and 4.361 values between 4.36 and 4.52offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. OTS
  2. .createObject
  3. "There
  4. angs
  5. SACTION
  6. Dion
  7. DH
  8. נן
  9. inction
  10. There

Suppresses

  1. 来源于
  2. inee
  3. 伙伴
  4. favor
  5. oeff
  6. 坐在
  7. 过往
  8. 宝
  9. ipl
  10. 得益于