Neuron Explorer

Qwen3-0.6B

commas mid-sentence before a continuation

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on commas in the middle of a sentence, where the sentence is set to carry on with more detail. Turning it up made the model's text wander into hesitant filler like "hmm... because... because", but that link is weak.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    of gardens, such as buildings and walls, can be permanent and outlive plant life. A detailed history of these gardens is preserved only with those who tended to, and experienced personally how these gardens evolved under their care. The walled garden at

  2. #2 peak

    41, which would have preserved sex-based fairness in K-12 sports. HEA 1041 would have required that only biological females, based on a person's sex at birth, can participate in female sports at an

  3. #3 peak

    focusing on the cultural self-awareness of a student. I am not even sure exactly what that entails or means. We should be focusing on what the title suggests, NC History. The standards leave it up to the teacher to choose which events or

  4. #4 peak

    50 years at one level of relative sea-level rise, when they should be building projects that can function for several generations as sea level rises twice as high, if not higher.”⏎Garret Graves, head of the state Coastal Planning and Protection

  5. #5 peak

    itoneal cancer.⏎Primary Peritoneal Carcinoma - an overview …⏎(8 days ago) Primary peritoneal carcinoma has a prognosis that overlaps with, or is the same as, tubal/ovarian carcinomas of similar hist

  6. #6 peak

    temperament. Perhaps most crucially, learn how you can survive an attack from one of these huge dogs, what you need to do once bitten, and also how the Dog Bite King can help you.⏎Great Danes And Their

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the following is a list of the following, and the following, and the following, as of the last week, based on the current day, as of the last week, based on the current day, and the following, as of the

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    this problem before, exemplified by previous papers from this group. I normally try not to be sarcastic here, but I don’t have time to edit today, so you’re getting raw, unfiltered exasperation this time.⏎There are

  2. #2 peak

    test. After researching this, I decided to do bean plants, due to the quick speeds that they grow at. My house doesn’t receive a lot of sunlight, so I purchased a grow light, and decided I would grow my plants inside.

  3. #3 peak

    health and substance abuse disorders did not seek treatment. About 15% of the respondents<|endoftext|>Okay, I am by no means knowledgable in this field, probably more dangerous than anything. But I have a question about gravity. If two

  4. #4 peak

    are some activities you could try with your children.⏎1. Brainstorm ways to save and collect money.⏎Your child may be too young for an official “job,” but that doesn’t mean he or she is too young for other entrepreneurial endeavors.

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L16:923 excites
  2. L11:578 excites
  3. L15:1175 weakly suppresses
  4. L16:1647 weakly excites
  5. L15:725 weakly excites
  6. L15:681 weakly suppresses
  7. L14:89 weakly excites
  8. L16:1112 weakly suppresses
  9. L10:721 weakly suppresses
  10. L14:67 weakly excites
  11. L7:2916 weakly excites
  12. L16:1653 weakly suppresses
  13. L16:2791 weakly suppresses
  14. L14:2504 weakly excites
  15. L10:586 weakly excites 'important' and degree words after 'how'
  16. L13:2767 weakly excites
  17. L16:636 weakly suppresses
  18. L2:1838 weakly suppresses
  19. L0:1195 weakly suppresses
  20. L16:1174 weakly suppresses
  21. L16:211 weakly excites
  22. L9:736 weakly suppresses
  23. L15:2111 weakly excites
  24. L11:782 weakly suppresses

Feeds later layers

  1. L18:862 suppresses hedges like 'it turns out' and 'if any'
  2. L20:663 suppresses
  3. L19:2645 excites commas in the middle of a sentence
  4. L20:2447 weakly excites
  5. L19:2931 weakly excites
  6. L20:2913 weakly suppresses
  7. L19:845 weakly suppresses
  8. L18:1404 weakly suppresses
  9. L18:1249 weakly excites
  10. L19:3044 weakly suppresses
  11. L18:2501 weakly suppresses
  12. L25:2641 weakly excites music and art genre words
  13. L21:344 weakly suppresses
  14. L20:1832 weakly excites 'as' introducing a reason
  15. L20:2280 weakly excites
  16. L20:852 weakly excites
  17. L21:1197 weakly excites
  18. L18:1179 weakly excites
  19. L20:2429 weakly excites
  20. L21:212 weakly suppresses
  21. L19:2040 weakly excites
  22. L18:3006 weakly excites
  23. L20:276 weakly suppresses
  24. L21:2996 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -10.14 and -9.741 values between -6.14 and -5.731 values between -5.33 and -4.933 values between -4.13 and -3.731 values between -3.73 and -3.332 values between -3.33 and -2.936 values between -2.93 and -2.537 values between -2.53 and -2.137 values between -2.13 and -1.7311 values between -1.73 and -1.3316 values between -1.33 and -0.9352 values between -0.93 and -0.53610 values between -0.53 and -0.131810 values between -0.13 and 0.28676 values between 0.28 and 0.68331 values between 0.68 and 1.08168 values between 1.08 and 1.48101 values between 1.48 and 1.8842 values between 1.88 and 2.2832 values between 2.28 and 2.6816 values between 2.68 and 3.0811 values between 3.08 and 3.481 values between 3.88 and 4.281 values between 5.08 and 5.481 values between 5.48 and 5.88offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. xDC
  2. []:⏎
  3. 只有一个
  4. 有用的
  5. الف
  6. ISING
  7. tern
  8. になった
  9. %"
  10. ampa

Suppresses

  1. bases
  2. (pt
  3. 所以我们
  4. endon
  5. ulum
  6. imens
  7. expo
  8. ardu
  9. (Be
  10. illez