Neuron Explorer

Qwen3-0.6B

word pieces like 'vent' and 'venk'

A neuron in layer 2 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on certain chopped-up pieces of words, such as 'vent' in hyperventilation or 'venk' in a person's surname. Its negative side fires on 'Mount' after words like 'Sacred' and 'on'. Turning it up gave wandering, unfocused text.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    interaction⏎As magnetic interactions are normally mediated by short-range exchange or weak dipole fields, the research team, which is co-led by Professor T Venky Venkates

  2. #2 peak

    more than one anxiety disorder. Sometimes anxiety results from a medical condition that needs treatment.⏎Common symptoms of anxiety would be increased heart rate, hyperventilation, sweating, nervousness, weakness, fatigue, fidgeting, inability

  3. #3 peak

    atlas is a series of cross sections of anatomical structure. In most atlases, the three dimensions are as latero-lateral (x), dorso-ventral (y) and rostro-caudal (z). Another one is

  4. #4 peak

    00s. The current edition of this standard is NFPA 211-2019: Standard For Chimneys, Fireplaces, Vents, And Solid Fuel-Burning Appliances.⏎Fire gives off heat energy, which can

  5. #5 peak

    /11/Sanitizing-Surfaces-in-Childcare-Environments-1.pdfWtare Quaity nd Health Council⏎Publication Type: Care guideline<|endoftext|>The Cooper

  6. #6 peak

    of chaotic systems (H. Qammari, A. Venkatesan). A vacation on Mars - an artist's journey in a computer graphics

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I am going to be in a new age, I have to go on. It's been a new age, I have to go on. It's been a new age, I have to go on. I am going to be in

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    and it has deeply influenced following developments of this phenomenon in the⏎rest of Europe.⏎Sacred Mounts of northern Italy represent the successful integration into a landscape of remarkable beauty of architecture

  2. #2 peak

    , twenty-seven inches wide, and twenty-seven inches deep. In it were to be placed the two tables of the law which Moses would receive directly from God on Mount Sinai (Ex

  3. #3 peak

    for the current demands.⏎4) Engine Stalls⏎When you start up your vehicle, and the engine turns on, you<|endoftext|>Darryl D’Monte continues his reportage of the Climate Action Network International meet on in Bangkok where,

  4. #4 peak

    ions (V Macedonica, XII Fulminata, XV Apollinaris) on the western side and a fourth (X Fretensis) on the Mount of Olives to the east. He put pressure on the food and water supplies

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:1224 suppresses
  2. L0:1301 suppresses
  3. L0:178 suppresses
  4. L1:30 weakly suppresses
  5. L0:1 weakly suppresses
  6. L1:2910 weakly excites
  7. L0:873 weakly suppresses
  8. L1:1464 weakly excites
  9. L1:340 weakly suppresses
  10. L1:1973 weakly suppresses
  11. L1:1110 weakly excites
  12. L1:491 weakly excites
  13. L1:1469 weakly suppresses
  14. L1:99 weakly excites
  15. L1:2101 weakly suppresses
  16. L1:32 weakly suppresses
  17. L1:951 weakly excites
  18. L0:246 weakly excites
  19. L1:92 weakly excites
  20. L1:2801 weakly excites
  21. L0:1347 weakly suppresses
  22. L0:2102 weakly suppresses
  23. L1:2764 weakly suppresses
  24. L0:2934 weakly excites

Feeds later layers

  1. L25:453 weakly excites
  2. L5:1203 weakly excites
  3. L4:1688 weakly excites
  4. L6:1591 weakly excites
  5. L6:1199 weakly excites
  6. L11:1418 weakly excites
  7. L10:2294 weakly excites
  8. L4:642 weakly suppresses
  9. L14:2280 weakly excites
  10. L14:571 weakly excites
  11. L16:779 weakly suppresses
  12. L13:2101 weakly excites
  13. L4:2109 weakly suppresses
  14. L21:1379 weakly excites
  15. L27:798 weakly excites
  16. L10:2118 weakly excites
  17. L7:686 weakly excites
  18. L4:1437 weakly excites
  19. L23:455 weakly excites
  20. L3:2322 weakly excites
  21. L10:1530 weakly suppresses
  22. L22:675 weakly suppresses
  23. L12:1316 weakly excites
  24. L19:2693 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.48 and -0.431 values between -0.43 and -0.3810 values between -0.38 and -0.349 values between -0.34 and -0.2921 values between -0.29 and -0.2463 values between -0.24 and -0.2089 values between -0.20 and -0.15195 values between -0.15 and -0.11377 values between -0.11 and -0.061118 values between -0.06 and -0.011134 values between -0.01 and 0.03503 values between 0.03 and 0.08202 values between 0.08 and 0.13101 values between 0.13 and 0.1747 values between 0.17 and 0.2215 values between 0.22 and 0.2610 values between 0.26 and 0.317 values between 0.31 and 0.362 values between 0.36 and 0.401 values between 0.40 and 0.451 values between 0.49 and 0.541 values between 1.32 and 1.37offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. @login
  2. inity
  3. etric
  4. entr
  5. usement
  6. 气体
  7. goo
  8. 满意
  9. 同学
  10. Launch

Suppresses

  1. -zA
  2. criptive
  3. wargs
  4. Hemp
  5. warts
  6. ansa
  7. iete
  8. 俳
  9. warz
  10. essor