Neuron Explorer

Qwen3-0.6B

comma after 'sometimes' or 'the truth'

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a comma that comes right after a short opening phrase like 'Sometimes,' or 'The truth,' or 'Not only does it work,', where a contrast such as 'but' or 'however' is likely to follow. Turning it up gave repetitive filler, and turning it down gave rambling, so the steering effect is not very informative.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    chicken and eggs are a good bet.⏎- Not all carbs are created equal. Consume complex carbs, like whole grains. Avoid sugar and white flour. Sorry,

  2. #2 peak

    difference.⏎Quality assurance is process oriented. It is all about preventing defects by ensuring the processes used to manage and create deliverables works. Not only does it work, but is consistently followed by the team. Moreover, QA is about engineering processes that

  3. #3 peak

    you wish to move up, you’ll need to prove again and again that you know how to navigate technology. Sometimes, having that little bit of extra knowledge can really make a difference in your salary and

  4. #4 peak

    to climate change in the future? We explore the invention of cooking meat. You’ll find out why the advancements of cooked food helped our brains grow. All that,

  5. #5 peak

    ensure they are not cancerous.⏎Sometimes, the doctor will suggest the individual wait to let the polyps go away on their

  6. #6 peak

    ing, canoeing and kayaking?⏎Is there, actually? Is rowing, canoeing and kayaking very different from each other? The answer is yes, they are. These are not three different techniques of operating the same boat. The

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I am:1:1000000000000000000000000000000000000010000

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    been easier!⏎Note: CD-ROM/DVD and other supplementary materials are not included as part of eBook file.<|endoftext|>is a former municipality in Akershus⏎, which lends its name to a municipality and a county in Norway⏎. The name

  2. #2 peak

    ,000 square kilometers, are the only source of protection for<|endoftext|>1911 Encyclopædia Britannica/Diamond⏎DIAMOND, a mineral universally recognized as chief among precious stones; it is the hardest, the

  3. #3 peak

    Cell Biology⏎Chlamydomonas; Dynein ATPase; Flagella; Microscopy, Electron; Microtubules⏎Analysis of serial cross-sections of the Ch

  4. #4 peak

    0 US$ 24.95 167 pages<|endoftext|>Gate is the national monument of India. Situated in the heart of New Delhi⏎, it was designed by Sir Edwin Lutyens.The monument is inspired by Arc de

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:3 strongly excites commas after citation fields
  2. L14:35 strongly suppresses
  3. L5:16 strongly excites
  4. L11:154 strongly suppresses commas after citation numbers
  5. L3:71 strongly suppresses
  6. L10:335 strongly excites commas in catalog, date, and list metadata
  7. L9:77 excites commas in citations and name lists
  8. L0:68 suppresses
  9. L2:66 excites
  10. L1:86 excites
  11. L0:232 suppresses
  12. L0:2921 suppresses
  13. L14:51 excites colon that introduces a statement
  14. L0:146 suppresses
  15. L0:346 excites comma closing an introductory phrase
  16. L5:1304 excites
  17. L0:584 excites
  18. L15:241 weakly excites
  19. L6:305 weakly excites
  20. L0:1596 weakly excites
  21. L15:82 weakly suppresses
  22. L10:10 weakly excites
  23. L1:1464 weakly excites
  24. L6:12 weakly excites

Feeds later layers

  1. L17:1405 strongly excites
  2. L19:726 strongly excites comma inside large numbers
  3. L17:116 strongly suppresses
  4. L17:118 strongly excites comma after a clause ending
  5. L18:1394 strongly excites
  6. L17:2001 strongly excites
  7. L18:366 strongly excites comma inside numbers and dates
  8. L17:585 strongly excites
  9. L19:2645 strongly excites commas in the middle of a sentence
  10. L18:2043 strongly excites
  11. L23:184 strongly excites
  12. L19:682 strongly suppresses
  13. L19:1826 strongly excites
  14. L22:368 suppresses
  15. L26:236 suppresses
  16. L17:627 excites
  17. L27:77 excites
  18. L19:383 excites commas after a clause or list item
  19. L27:358 suppresses
  20. L20:2082 suppresses
  21. L20:1298 excites
  22. L21:700 excites comma before a new clause
  23. L17:2597 excites
  24. L20:476 excites commas that lead into a continuation

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

246 values between -1.51 and -1.101152 values between -1.10 and -0.691573 values between -0.69 and -0.28755 values between -0.28 and 0.134 values between 0.13 and 0.542 values between 0.54 and 0.942 values between 1.35 and 1.762 values between 2.17 and 2.582 values between 3.40 and 3.812 values between 3.81 and 4.223 values between 4.63 and 5.042 values between 5.04 and 5.455 values between 5.45 and 5.863 values between 5.86 and 6.275 values between 6.27 and 6.686 values between 6.68 and 7.0912 values between 7.09 and 7.5010 values between 7.50 and 7.9111 values between 7.91 and 8.327 values between 8.32 and 8.7311 values between 8.73 and 9.138 values between 9.13 and 9.5416 values between 9.54 and 9.9513 values between 9.95 and 10.368 values between 10.36 and 10.7716 values between 10.77 and 11.186 values between 11.18 and 11.593 values between 11.59 and 12.006 values between 12.00 and 12.414 values between 12.41 and 12.824 values between 12.82 and 13.231 values between 13.23 and 13.641 values between 13.64 and 14.054 values between 14.05 and 14.463 values between 14.46 and 14.87offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. which
  2. particularly
  3. especially
  4. 但是如果
  5. but
  6. which
  7. 特别是在
  8. however
  9. SqlDbType
  10. itol

Suppresses

  1. ,
  2. ,在
  3. -,
  4. ,⏎⏎⏎⏎
  5. ,b
  6. ,
  7. ,d
  8. ،
  9. ,www
  10. ,则