Neuron Explorer

Qwen3-0.6B

the word 'be' after modals

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to the word 'be' when it comes right after a helper word like 'can', 'need to', 'going to' or 'please'. Turning it up made the model's writing wander and repeat rather than show any clear topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    -term, abstract goals that may have been set by their parents (“You will become a doctor!”), but clearly defined ambitions of students themselves. So, what can be achieved with great results in school? Forget long-term goals and focus on short-term

  2. #2 peak

    a job seeker who cares about the long-term sustainability of the environment, there are many things you need to be doing right now that will position you to be able to participate in the development of

  3. #3 peak

    heart or blood vessel problems, such as high cholesterol or high blood pressure, a healthy lifestyle can help you manage those problems.⏎If you have children, you can be their healthy role model. If your habits are healthy, your children are more likely

  4. #4 peak

    proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.⏎As the access to this document is restricted

  5. #5 peak

    point.⏎Because many older people suffer from hazardous falls, having good vision is necessary to prevent them. Already having had a serious fall myself, I’m going to be very anxious to get this surgery done before my vision gets bad.⏎I urge everyone

  6. #6 peak

    exercises or eating the wrong things.⏎To stop you from making mistakes at the dinner table, Bright Side has listed some of the most common diet mistakes. You could be guilty of committing some of these too!⏎1. Thinking that all calories are equal

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    " uses 9 letters: A D E L M N O P S.⏎No direct anagrams for endoplasm found in this word list.⏎Words formed by adding one letter before or after endoplasm (in bold), or to adel

  2. #2 peak

    ATRIP complex induces the Fanconi Anemia repair and Nucleotide Excision Repair (NER) pathways, as well as the p53 signaling pathway. C. Finally, a

  3. #3 peak

    we don’t vote ordinary people are involved in political parties and in national/local government, they can be taken over by people who may represent a minority interest. People’s rights and freedoms are preserved by

  4. #4 peak

    others can be purchased by visiting us at 111 Fairgrounds Road in Rolla, or by calling us. Low resolution images of many may be viewed by visiting the Geologic Map Index.⏎What is a geologic map?⏎Like all

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L16:160 weakly excites
  2. L16:282 weakly excites
  3. L16:1557 weakly suppresses 'in' meaning 'in this case' or 'in between'
  4. L10:29 weakly suppresses
  5. L15:78 weakly excites
  6. L14:246 weakly excites
  7. L0:1183 weakly suppresses
  8. L10:201 weakly suppresses the letter B in vitamin names
  9. L14:1242 weakly suppresses
  10. L14:570 weakly suppresses
  11. L16:2666 weakly excites
  12. L12:571 weakly excites
  13. L4:1319 weakly excites the 'B' in vitamin B
  14. L16:374 weakly excites
  15. L10:887 weakly suppresses the B in vitamin B names
  16. L16:90 weakly suppresses
  17. L5:203 weakly excites
  18. L14:251 weakly suppresses
  19. L16:1808 weakly suppresses
  20. L4:428 weakly suppresses
  21. L12:999 weakly excites
  22. L16:344 weakly suppresses
  23. L2:656 weakly suppresses
  24. L13:988 weakly excites

Feeds later layers

  1. L19:1001 strongly excites "be" after will or you'll
  2. L23:999 excites "be" after modal verbs
  3. L20:1540 excites
  4. L19:1750 suppresses
  5. L19:1115 suppresses
  6. L24:1811 suppresses
  7. L20:636 suppresses
  8. L26:1233 weakly suppresses
  9. L19:2033 weakly excites
  10. L20:1618 weakly excites 'be' after 'to' or 'need to'
  11. L26:1269 weakly suppresses
  12. L22:550 weakly excites
  13. L23:220 weakly suppresses
  14. L21:1675 weakly excites
  15. L23:847 weakly excites
  16. L19:1612 weakly excites
  17. L20:2254 weakly excites
  18. L25:546 weakly excites
  19. L21:935 weakly suppresses
  20. L27:644 weakly suppresses
  21. L18:960 weakly excites
  22. L25:1852 weakly excites
  23. L19:1613 weakly excites "is" after a sentence-opening "It"
  24. L18:1471 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

131 values between -1.67 and -0.773340 values between -0.77 and 0.14302 values between 0.14 and 1.0460 values between 1.04 and 1.9421 values between 1.94 and 2.8513 values between 2.85 and 3.7510 values between 3.75 and 4.654 values between 4.65 and 5.562 values between 5.56 and 6.461 values between 6.46 and 7.372 values between 7.37 and 8.271 values between 9.17 and 10.081 values between 10.08 and 10.981 values between 10.98 and 11.881 values between 13.69 and 14.591 values between 14.59 and 15.502 values between 19.11 and 20.011 values between 20.01 and 20.921 values between 21.82 and 22.724 values between 22.72 and 23.632 values between 23.63 and 24.531 values between 24.53 and 25.431 values between 25.43 and 26.341 values between 26.34 and 27.242 values between 27.24 and 28.141 values between 29.95 and 30.861 values between 33.57 and 34.47offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 蝠
  2. 发展趋势
  3. Baum
  4. _Struct
  5. Carb
  6. friend
  7. ',['../
  8. спект
  9. ]=-
  10. utors

Suppresses

  1. not
  2. being
  3. seg
  4. probably
  5. -se
  6. 代
  7. 一定是
  8. /oauth
  9. oret
  10. own