Neuron Explorer

Qwen3-0.6B

'is' after a long subject phrase

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the small word 'is' (or 's) that comes right after a long subject, as in 'Making sure your soil is... is important' or 'Interesting fact is that'. When turned up, the model got stuck repeating 'is' or 'was' over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    ability to bring in subtle elements, to pause and consider is vital for their patient.⏎We now have artificial intelligence which can replicate part of the

  2. #2 peak

    returns, you collect and analyze the information gathered by the instruments you designed. This information is pivotal in gaining a clearer picture of how the aircraft is functioning.⏎This is a job that requires an acute attention to detail. Test flights are

  3. #3 peak

    got a newsletter from the unmanned-vehicles industry about all the cool things robots are doing to help Japan. It has not a word about the nuclear reactors. That's disgraceful.⏎To head off the next nuclear accident, we need to rethink the

  4. #4 peak

    were discovered in this isolated location, such as:⏎The mountain acts like an island in the vast sea of jungle, isolating the wildlife on it. Interesting fact is that most wildlife living in the Bosavi Crater show little to no fear of

  5. #5 peak

    robot to take home with them! For kids entering 2nd-6th grade in fall 2021.<|endoftext|>Create your own garden at home is not easy. Therefore, many people who entrust the construction of gardens on expert

  6. #6 peak

    pests, and watering your garden more natural and sustainable.⏎Making sure you build your soil so that your crops get adequate nutrients is important—and you can definitely accomplish this goal without buying anything in a package or a

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: is is is is is is is is is is is is is is is is is is is is is is is is is... (this is is is is is is... etc. is is... etc. is... etc. is is

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    do not require the last check, but none of real⏎"I have come to believe that the whole world is an enigma, a harmless enigma⏎that is made terrible by our own mad attempt to interpret it as though it had⏎an

  2. #2 peak

    women who weigh more or who exercise regularly.⏎Very low calorie diets of fewer than 800 calories per day should not be used unless you are being monitored by your doctor.⏎Healthy Weight Tip⏎Set goals to eat healthy like

  3. #3 peak

    feeling secure gives children the confidence they need to explore, learn and take on the world!⏎Talk, Sing and Point⏎Babies learn language from the moment they are born. To a newborn baby, speech is just sound. Then, day by

  4. #4 peak

    Why Lesson Planet?⏎Find quality lesson planning resources, fast!⏎Share & remix collections to collaborate.⏎Organize your curriculum with collections. Easy!⏎Have time to be more creative & energetic with your students!⏎Students participate in a variety of physical activities

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L6:2237 strongly excites
  2. L4:20 strongly suppresses
  3. L4:24 excites
  4. L9:66 excites
  5. L14:827 suppresses open bracket after a value or citation
  6. L0:1329 excites
  7. L3:76 suppresses
  8. L4:2128 suppresses
  9. L10:417 suppresses
  10. L1:301 suppresses
  11. L1:1814 excites
  12. L13:897 excites
  13. L15:286 excites
  14. L1:1791 suppresses
  15. L0:207 excites
  16. L6:858 excites
  17. L10:206 excites colon or equals sign before a definition
  18. L4:116 suppresses
  19. L2:1935 excites
  20. L10:272 suppresses
  21. L3:2899 suppresses
  22. L8:137 weakly suppresses
  23. L15:599 weakly excites
  24. L7:3018 weakly suppresses

Feeds later layers

  1. L19:1613 strongly excites "is" after a sentence-opening "It"
  2. L17:882 suppresses
  3. L17:1473 excites
  4. L19:2656 excites
  5. L18:857 suppresses
  6. L20:1253 excites
  7. L17:227 excites
  8. L19:1115 suppresses
  9. L23:1160 excites
  10. L21:1434 excites
  11. L19:983 excites
  12. L19:2450 excites
  13. L20:1540 excites
  14. L18:1415 excites
  15. L17:1851 excites
  16. L17:1013 excites
  17. L19:835 excites
  18. L20:1618 excites 'be' after 'to' or 'need to'
  19. L23:360 suppresses
  20. L18:1061 excites
  21. L27:1368 excites
  22. L19:2511 excites
  23. L17:2756 excites
  24. L18:1036 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.48 and -3.102 values between -3.10 and -2.732 values between -2.36 and -1.983 values between -1.61 and -1.2425 values between -1.24 and -0.86716 values between -0.86 and -0.492310 values between -0.49 and -0.12703 values between -0.12 and 0.2628 values between 0.26 and 0.6316 values between 0.63 and 1.006 values between 1.00 and 1.377 values between 1.37 and 1.759 values between 1.75 and 2.128 values between 2.12 and 2.499 values between 2.49 and 2.876 values between 2.87 and 3.249 values between 3.24 and 3.616 values between 3.61 and 3.996 values between 3.99 and 4.366 values between 4.36 and 4.733 values between 4.73 and 5.104 values between 5.10 and 5.482 values between 5.48 and 5.852 values between 5.85 and 6.223 values between 6.22 and 6.603 values between 6.60 and 6.971 values between 6.97 and 7.341 values between 7.34 and 7.721 values between 7.72 and 8.094 values between 8.46 and 8.831 values between 8.83 and 9.212 values between 9.21 and 9.581 values between 9.95 and 10.331 values between 10.33 and 10.701 values between 11.07 and 11.45offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. Permanent
  2. ards
  3. 好事
  4. 些什么
  5. 一回事
  6. ursors
  7. 什麽
  8. ometrics
  9. houses
  10. mdi

Suppresses

  1. él
  2. iler
  3. ullah
  4. но
  5. inho
  6. atz
  7. 代
  8. 是
  9. ه
  10. 是以