Neuron Explorer

Qwen3-0.6B

comma after an introductory phrase

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the comma that ends an opening phrase, such as 'As your company grows,' or 'When choosing a kit,', just before the main sentence starts. Turning it up gave text that did not clearly relate to the comma pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    20|⏎|Order Information:||Web: http://www.tandfonline.com/pricing/journal/VECE20|⏎When requesting a correction, please mention this item's handle: RePEc:taf:jeduce

  2. #2 peak

    normal for one person, while three a week may be normal for another. Also, some people naturally have firmer stools than others.⏎At one time or another, almost everyone gets constipated. Poor diet and a lack of exercise are the most

  3. #3 peak

    When it comes to game design, it's mainly about creating a world that imitates their own world and letting them

  4. #4 peak

    sentences) (Resource Book Only) eBookKindergarten|Grade 1⏎Please Note: This ebook is a digital download, NOT a physical product. After purchase, you will be provided a one time link to download ebooks to your computer. Orders

  5. #5 peak

    . This helps prevent unauthorised users from accessing sensitive information.⏎Cloud services allow you to scale your security measures according to your business needs. As your company grows, you can easily adapt and enhance your security protocols without significant infrastructure investments. This flexibility

  6. #6 peak

    verification, such as finance, supply chain management, and voting systems. It eliminates the need for intermediaries and enables secure and efficient transactions. As blockchain technology matures, we can expect

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: ... and ... 33,333,333,333,333,333,333,333,333,333,333,3

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    863)⏎This paper is intended to give an example of the impact of optical shows in relation to the dissemination of stereoscopy in Spain. Concretely, I will be focusing on a stereoscopic show run by the optician Francisco

  2. #2 peak

    rules. It is these traffic rules that pose a challenge in light of the development of automated vehicles. More specifically, the development of fully automated vehicles that can operate without human interference is currently not

  3. #3 peak

    , and does tend to be more expensive.⏎Calcium carbonate tends to be less expensive and contains more elemental calcium but requires stomach acids to be absorbed. Because of this, calcium carbonate is absorbed better when taken with food.⏎The amount of calcium absorbed

  4. #4 peak

    The question is why?⏎Researchers at the University of Minnesota set out to discover if nutrition facts labels are optimally designed to help consumers make healthier food choices. More specifically, they looked at how the locations of components on nutrition labels relate to a consumer

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L12:1352 suppresses
  2. L6:2843 suppresses
  3. L6:1485 excites
  4. L16:2102 excites
  5. L12:2772 suppresses comma after an introductory phrase
  6. L11:1084 excites
  7. L8:410 suppresses
  8. L9:1579 suppresses
  9. L16:1886 excites
  10. L6:1829 suppresses
  11. L16:826 weakly suppresses
  12. L14:1276 weakly suppresses
  13. L15:853 weakly suppresses
  14. L16:1826 weakly suppresses
  15. L16:2083 weakly excites comma after 'in this article'
  16. L15:452 weakly suppresses
  17. L6:2233 weakly excites
  18. L11:308 weakly excites
  19. L16:1388 weakly excites
  20. L14:1242 weakly suppresses
  21. L14:2011 weakly excites
  22. L13:958 weakly suppresses
  23. L11:506 weakly excites
  24. L0:1770 weakly suppresses

Feeds later layers

  1. L18:126 suppresses comma joining a full clause
  2. L19:384 excites
  3. L22:689 excites comma closing an intro clause
  4. L18:1246 suppresses
  5. L18:1700 excites 'so' in 'and so on'
  6. L21:191 suppresses
  7. L21:310 excites
  8. L19:94 suppresses
  9. L21:721 excites
  10. L24:398 excites
  11. L20:242 suppresses
  12. L21:639 excites
  13. L19:433 weakly excites
  14. L23:709 weakly excites
  15. L18:41 weakly excites
  16. L19:2741 weakly excites
  17. L19:1332 weakly excites
  18. L19:1788 weakly excites
  19. L18:727 weakly suppresses
  20. L19:695 weakly suppresses
  21. L18:172 weakly suppresses
  22. L21:2808 weakly excites
  23. L19:262 weakly excites
  24. L18:2393 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -6.32 and -5.573 values between -5.57 and -4.815 values between -4.81 and -4.065 values between -4.06 and -3.313 values between -3.31 and -2.5513 values between -2.55 and -1.8081 values between -1.80 and -1.05250 values between -1.05 and -0.293301 values between -0.29 and 0.46163 values between 0.46 and 1.2122 values between 1.21 and 1.975 values between 1.97 and 2.727 values between 2.72 and 3.473 values between 3.47 and 4.231 values between 4.98 and 5.731 values between 6.49 and 7.241 values between 7.24 and 7.993 values between 8.75 and 9.506 values between 9.50 and 10.251 values between 10.25 and 11.011 values between 11.01 and 11.762 values between 11.76 and 12.513 values between 12.51 and 13.273 values between 13.27 and 14.021 values between 14.02 and 14.771 values between 14.77 and 15.536 values between 15.53 and 16.284 values between 16.28 and 17.031 values between 17.03 and 17.793 values between 17.79 and 18.543 values between 18.54 and 19.291 values between 20.05 and 20.802 values between 22.31 and 23.061 values between 23.06 and 23.81offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. angers
  2. %;"
  3. esity
  4. oner
  5. ilated
  6. ";//
  7. latlong
  8. ');?>⏎
  9. attackers
  10. %"><

Suppresses

  1. ENA
  2. ex
  3. ис
  4. 腋
  5. .ant
  6. DOI
  7. inned
  8. ACL
  9. EX
  10. rich