Neuron Explorer

Qwen3-0.6B

comma after a clause ending

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a comma that comes right after a complete clause, where a list, an explanation or a contrast is about to follow, like "satiated, but" or "offer kid-friendly features, such as". Turned up, the model fell into repeating filler words like "and and and".

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    to send people to space.⏎So if NASA’s Planetary Protection Officer—there is one—is going to live up to the coolest job title in the solar system, the space agency is going to need some different rules for keeping Earth’s bugs on

  2. #2 peak

    1939 the country stood alone against the might of the German war machine, a plucky but woefully under-equipped little island. It initially suffered setbacks, and finally won the war in 1945 thanks to the intervention of

  3. #3 peak

    miracles of productivity. Perhaps “still” is the wrong word given the improvements in technology and sheer productive capacity over the last half century. If we often seem paralyzed, unable to accomplish basic tasks, it is because of a failure of nerve and guiding

  4. #4 peak

    this amount with your child beforehand), it’s time to open an official saving account and deposit it into the bank. Some banks and credit unions offer kid-friendly features, such as online games, rewards for getting good grades, and other perks.⏎4

  5. #5 peak

    ness, and better memory and recall.⏎One simple reason for this is that ensuring you consume protein, carbs, vitamins, and fats not only keeps you satiated, but also provides you the energy you need to fuel your day.⏎An easy way

  6. #6 peak

    ier blood sugar levels and sustained energy. Also, complex carbohydrates tend to provide more vitamins and minerals than sources of simple sugars.⏎Sugar has its place in your diet, but many health and diet experts warn that excess sugar consumption can lead to several serious

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately:,,,,,,,,,,,,,,,,,,,,,,,,,|||||||||||.||||.||.||.||.|.|

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Today, many keyboard and mice use the USB interface.<|endoftext|>fEMPOWER: workshopping

  2. #2 peak

    00,000) is higher than that found in most African countries and much higher than in China as a whole (53/100,000

  3. #3 peak

    2,019 waterbodies had 5 or more years of data. When the University of Florida data are added, the number jumps to 4,800 waterbodies. Of these, 17% had significant

  4. #4 peak

    salaries for electricians, at $72,030, followed by New York at $70,680, Illinois at $70,430, Hawaii at $68,430 and New Jersey

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L16:240 strongly excites comma after 'sometimes' or 'the truth'
  2. L14:35 strongly suppresses
  3. L9:77 excites commas in citations and name lists
  4. L11:154 suppresses commas after citation numbers
  5. L4:3 excites commas after citation fields
  6. L10:335 excites commas in catalog, date, and list metadata
  7. L5:16 excites
  8. L15:588 excites comma after an introductory phrase
  9. L3:71 suppresses
  10. L16:241 excites
  11. L0:68 suppresses
  12. L0:146 suppresses
  13. L16:846 excites comma opening an aside or explanation
  14. L16:710 excites
  15. L1:86 excites
  16. L15:123 weakly suppresses
  17. L16:1082 weakly suppresses comma linking two clauses after 'and'
  18. L2:66 weakly excites
  19. L16:1939 weakly excites line break mid-sentence in wrapped text
  20. L12:1557 weakly suppresses comma after an introductory phrase
  21. L5:91 weakly excites
  22. L16:762 weakly suppresses
  23. L16:432 weakly excites period after month or initial
  24. L0:346 weakly excites comma closing an introductory phrase

Feeds later layers

  1. L19:726 strongly excites comma inside large numbers
  2. L18:366 strongly excites comma inside numbers and dates
  3. L23:184 strongly excites
  4. L20:476 excites commas that lead into a continuation
  5. L19:383 excites commas after a clause or list item
  6. L22:144 excites
  7. L24:902 excites
  8. L20:1298 excites
  9. L19:1826 excites
  10. L19:2645 excites commas in the middle of a sentence
  11. L18:1394 excites
  12. L18:2043 excites
  13. L27:77 excites
  14. L18:2863 excites
  15. L20:2082 suppresses
  16. L19:1506 excites
  17. L18:1270 excites
  18. L21:50 excites comma after 'So' or intro phrase
  19. L21:700 excites comma before a new clause
  20. L19:1598 excites comma before a qualifying clause
  21. L26:94 excites
  22. L25:535 excites commas inside number lists
  23. L18:227 suppresses
  24. L27:139 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

364 values between -1.99 and -1.122848 values between -1.12 and -0.25521 values between -0.25 and 0.622 values between 0.62 and 1.481 values between 1.48 and 2.352 values between 2.35 and 3.223 values between 3.22 and 4.095 values between 4.09 and 4.956 values between 4.95 and 5.823 values between 5.82 and 6.693 values between 6.69 and 7.565 values between 7.56 and 8.432 values between 8.43 and 9.298 values between 9.29 and 10.168 values between 10.16 and 11.037 values between 11.03 and 11.907 values between 11.90 and 12.767 values between 12.76 and 13.635 values between 13.63 and 14.5011 values between 14.50 and 15.376 values between 15.37 and 16.233 values between 16.23 and 17.105 values between 17.10 and 17.979 values between 17.97 and 18.845 values between 18.84 and 19.705 values between 19.70 and 20.578 values between 20.57 and 21.447 values between 21.44 and 22.316 values between 22.31 and 23.187 values between 23.18 and 24.047 values between 24.04 and 24.915 values between 24.91 and 25.788 values between 25.78 and 26.653 values between 26.65 and 27.511 values between 27.51 and 28.381 values between 28.38 and 29.252 values between 30.12 and 30.982 values between 31.85 and 32.72offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. especially
  2. particularly
  3. albeit
  4. which
  5. particularly
  6. 特别是在
  7. 特别是
  8. namely
  9. specifically
  10. 以及

Suppresses

  1. ,
  2. ,M
  3. -on
  4. -date
  5. date
  6. -help
  7. рат
  8. MORE
  9. -stack
  10. -p