Neuron Explorer

Qwen3-0.6B

'is' right after 'there' or 'nor'

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to the word 'is' when it comes straight after 'there' or after a word like 'nor' or 'so', as in 'there is a risk' or 'nor is it widely understood'. Turning it up made the model repeat phrases such as 'I am not sure'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    popular activity during these sunny days – don’t let ticks ruin your fun! We are entering the peak months for tick adult activity in San Mateo County. There is not necessarily a higher risk of tick-borne disease in San Mateo County compared

  2. #2 peak

    be considered Communized synonyms. In case you want even more details, you can also consider checking out all of the definitions of the word Communized. If there is a match we also include idioms & quotations that either use this word or its

  3. #3 peak

    Apples are beneficial in Diabetes⏎Apple are very effective in the treatment of diabetes. Apples contain a rich, natural therapeutic substance called pectin. There is p

  4. #4 peak

    to break. This is not to say that all gambling is an addiction. Just as many people who drink alcoholic beverages are not addicted to alcohol consumption, so too is it the case that many people who engage in gambling are not addicted to it.

  5. #5 peak

    Australian Journal of General Practice (2021) but many of us don’t really understand what this diagnosis entails beyond the tell-tale tremors, nor is it widely understood that exercise can play an important role in managing this disease.⏎So

  6. #6 peak

    , usually including nicotine, into an aerosol inhaled by the user.⏎They are promoted as a healthier alternative and an aid for quitting tobacco cigarettes, but there is debate over their safety. Health departments throughout Utah have started regulating e-cigarettes, mostly

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: what are the one who have to be the last one? The question are asking for those who are the last ones in their own, but if you take a person in the middle, you have to be on the ones who are last.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    They also boil, bake in hot ashes and roast. Common foods include:⏎It is a sticky mixture of flour and water and is accompanied by vegetables, meat, milk or

  2. #2 peak

    use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.⏎Disabilities Awareness

  3. #3 peak

    from pimples on the skin that can leave ugly marks behind after they have healed. There are many diseases that cause problems with the skin. Chicken pox is a common condition that causes boils to form on the skin. The boils that burst or

  4. #4 peak

    in OED from one of Fletcher’s lesser-known plays, The Woman’s Prize, evidences. (I must get round to reading this one, it’s a sequel to The Taming of the Shrew

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L6:114 strongly suppresses
  2. L8:253 excites
  3. L9:1062 suppresses
  4. L5:1645 suppresses
  5. L10:1190 excites
  6. L4:450 suppresses
  7. L10:661 excites
  8. L13:535 suppresses
  9. L5:13 suppresses
  10. L4:298 suppresses
  11. L11:282 excites
  12. L7:263 suppresses
  13. L7:327 suppresses
  14. L2:326 excites
  15. L12:1587 excites
  16. L6:424 suppresses
  17. L5:478 suppresses
  18. L7:672 suppresses
  19. L8:1220 excites
  20. L5:105 suppresses
  21. L9:55 suppresses
  22. L12:642 suppresses
  23. L8:759 excites
  24. L3:654 suppresses article 'a' after 'here are'

Feeds later layers

  1. L20:1989 strongly excites
  2. L19:1331 strongly excites
  3. L22:1081 strongly excites
  4. L20:1047 strongly suppresses
  5. L19:654 strongly excites
  6. L20:240 strongly excites
  7. L24:434 suppresses
  8. L23:218 excites
  9. L25:377 suppresses
  10. L27:60 excites
  11. L17:1696 suppresses
  12. L20:807 suppresses
  13. L17:963 suppresses
  14. L25:812 suppresses
  15. L24:109 excites
  16. L19:626 suppresses
  17. L24:488 suppresses
  18. L19:2522 suppresses
  19. L25:335 suppresses
  20. L18:927 excites
  21. L17:1524 suppresses
  22. L24:360 excites
  23. L26:111 suppresses
  24. L19:2593 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -4.00 and -3.451 values between -3.45 and -2.903 values between -2.90 and -2.352 values between -2.35 and -1.808 values between -1.80 and -1.25471 values between -1.25 and -0.702114 values between -0.70 and -0.151044 values between -0.15 and 0.4158 values between 0.41 and 0.9641 values between 0.96 and 1.5135 values between 1.51 and 2.0629 values between 2.06 and 2.6117 values between 2.61 and 3.1615 values between 3.16 and 3.719 values between 3.71 and 4.278 values between 4.27 and 4.825 values between 4.82 and 5.376 values between 5.37 and 5.927 values between 5.92 and 6.474 values between 6.47 and 7.026 values between 7.02 and 7.572 values between 7.57 and 8.123 values between 8.12 and 8.681 values between 8.68 and 9.231 values between 9.23 and 9.783 values between 9.78 and 10.332 values between 10.33 and 10.881 values between 10.88 and 11.432 values between 11.43 and 11.981 values between 11.98 and 12.532 values between 12.53 and 13.091 values between 13.09 and 13.641 values between 14.19 and 14.742 values between 14.74 and 15.291 values between 17.50 and 18.05offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. havoc
  2. inity
  3. ilig
  4. ledge
  5. 这是一个
  6. omencl
  7. ่ะ
  8. vironment
  9. enzie
  10. ategorie

Suppresses

  1. phases
  2. 两款
  3. ayers
  4. nants
  5. 两种
  6. blobs
  7. iments
  8. 几张
  9. 两类
  10. ilters