Neuron Explorer

Qwen3-0.6B

unclear: weak mixed activations

A neuron in layer 5 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron is hard to pin down. Its strongest responses are weak and scattered over ordinary words in health, biology and math text, with no shared meaning. Its negative side fires on 'of' after 'one' or 'some'. Turning it up gave unrelated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    harmful or toxic substances (toxins) and excretes them as harmless by-products to be eliminated by the intestines or filtered out by the kidneys⏎Produces immune factors and removes bacteria to help the body fight infection⏎The liver receives blood

  2. #2 peak

    the upper part of your spine, near your neck. If you have kyphosis, your spine looks hunched near your shoulder area.⏎Spinal curvature: Causes and symptoms⏎Most spinal curvature is “idiopathic,” which means the cause isn

  3. #3 peak

    what level can we remove wood that's going to be sustainable into the future? Does it make sense to overuse the forest for one use if it's going to compromise other uses? Our forests are incredibly important for harvesting but also for tourism [

  4. #4 peak

    As a fat-soluble vitamin -- others are A, E and K -- vitamin D can be stored in the tissues of your body. This is in sharp contrast to water-soluble vitamins, excess quantities of which are flushed from the body

  5. #5 peak

    include a pregnant woman's enhanced sense of smell and gastric reflux.⏎Morning sickness that is not severe does not hurt your baby in any way. In fact:⏎- It may even be a sign that all is well with you

  6. #6 peak

    use of ethical language.⏎What is the meaning and nature of a moral judgement? Are statements descriptive, prescriptive or emotive, or do they correspond to an objective, universal goodness which we attempt to access through moral debates?

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: "I need to think about this for 120 minutes." Okay, so you need to think about this for 120 minutes. That is, 1 hour, 120 minutes, so you need to think

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    be one of the largest in the area. For surrounding landowners, the project will promote different

  2. #2 peak

    materials and resources selection; indoor environmental quality and innovation and design process. To achieve LEED certification, buildings must earn points in one of the many LEED Rating Systems categories validated through a third-party certifier.⏎From

  3. #3 peak

    resources, templates, and ready-made games which you or your students could use to create Break Out scenarios. It is easy– you can sign up and use some of the games already on their website. Kits are available from their website and Amazon.com

  4. #4 peak

    of War. Recently published findings on primates and the nature of early man, especially the behaviour of hunter-gatherer societies, have caused him to change some of his views about the nature of modern man. The new research has overturned previous assumptions

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L3:56 suppresses
  2. L3:1054 excites
  3. L2:59 suppresses
  4. L2:1677 suppresses
  5. L3:940 excites
  6. L3:1440 weakly excites
  7. L3:489 weakly suppresses
  8. L2:2890 weakly suppresses
  9. L3:94 weakly suppresses
  10. L2:932 weakly excites
  11. L3:457 weakly suppresses
  12. L3:30 weakly excites
  13. L0:1331 weakly excites
  14. L1:1470 weakly excites
  15. L3:2755 weakly suppresses
  16. L2:1464 weakly suppresses
  17. L4:1680 weakly suppresses
  18. L0:441 weakly suppresses
  19. L4:473 weakly suppresses
  20. L3:734 weakly excites
  21. L2:1292 weakly excites
  22. L3:1071 weakly excites
  23. L2:1639 weakly suppresses
  24. L3:800 weakly suppresses

Feeds later layers

  1. L16:239 suppresses
  2. L10:579 suppresses
  3. L9:194 suppresses
  4. L6:157 suppresses "of" after process or action nouns
  5. L9:209 excites
  6. L7:119 excites
  7. L8:928 excites
  8. L8:697 excites
  9. L9:3065 excites
  10. L14:2462 excites
  11. L8:1213 excites
  12. L20:1292 excites
  13. L14:298 suppresses
  14. L27:2793 excites
  15. L6:399 excites
  16. L20:526 weakly excites
  17. L10:2533 weakly excites
  18. L18:1321 weakly excites
  19. L8:605 weakly excites
  20. L10:1705 weakly excites
  21. L8:1120 weakly excites
  22. L15:1146 weakly excites
  23. L10:1317 weakly excites
  24. L16:2117 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -1.89 and -1.801 values between -1.80 and -1.702 values between -1.70 and -1.602 values between -1.60 and -1.515 values between -1.51 and -1.415 values between -1.41 and -1.312 values between -1.31 and -1.227 values between -1.22 and -1.126 values between -1.12 and -1.0215 values between -1.02 and -0.9316 values between -0.93 and -0.8322 values between -0.83 and -0.7325 values between -0.73 and -0.6436 values between -0.64 and -0.5457 values between -0.54 and -0.4472 values between -0.44 and -0.35115 values between -0.35 and -0.25219 values between -0.25 and -0.15468 values between -0.15 and -0.061115 values between -0.06 and 0.04621 values between 0.04 and 0.14344 values between 0.14 and 0.24250 values between 0.24 and 0.33187 values between 0.33 and 0.43102 values between 0.43 and 0.5363 values between 0.53 and 0.6252 values between 0.62 and 0.7235 values between 0.72 and 0.8222 values between 0.82 and 0.9116 values between 0.91 and 1.017 values between 1.01 and 1.118 values between 1.11 and 1.205 values between 1.20 and 1.302 values between 1.30 and 1.401 values between 1.40 and 1.491 values between 1.88 and 1.98offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. athlon
  2. 试试
  3. feud
  4. ivist
  5. &type
  6. widow
  7. alley
  8. kế
  9. ocoder
  10. ucci

Suppresses

  1. olate
  2. known
  3. going
  4. فيه
  5. Known
  6. Incoming
  7. portion
  8. binding
  9. ending
  10. proportions