Neuron Explorer

Qwen3-0.6B

"above" after "the" pointing back

A neuron in layer 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "above" when it follows "the" and points back to something already said, like "the above circuit diagram". Turning it up did not produce a clear change in the written text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    various biological systems. It is postulated that NO plays a protective role by acting mainly on the interruption of free radicals formed under oxidative stress. Given the above, our objective is to evaluate the influence of NO in physiological responses of sugar cane

  2. #2 peak

    , lines and other symbols should be used to show how different components are connected. This information is crucial for figuring out the operation of the circuit.⏎By following the above circuit diagram rules, you'll be

  3. #3 peak

    .⏎Since the above three linkage movements are all rotary movements, but in fact, the linear movement is

  4. #4 peak

    needed in the aluminum smelting process?⏎Aluminum and aluminum alloy melts contain a large amount of hydrogen, metal and non-metallic inclusions.⏎If the above harmful substances cannot be removed in time before casting, casting defects such as pores,

  5. #5 peak

    on that one.<|endoftext|>Watch: 1929 Stock Market Crash and the Great Depression – Documentary [58:35 minutes]⏎After watching the above video and the relevant discussion in Special

  6. #6 peak

    3d_ref kill_this);⏎The compiler doesn't read your code like this - the following code is exactly the same to a compiler:⏎As humans though, the above is a lot more like gibberish.⏎void * load_model_from_disk(const

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the art of a painter, the voice of a singer, the hope of a hope, the light of a light. So many more artists, singers, and hope, and lights! I am doing it for the environment of a positive,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    B), a private conservation organization that holds Rio Bravo in trust for the people of Belize. PfB integrates elements of sustainable forestry and natural product harvesting, ecotourism, and education into a single comprehensive long-term management plan. For a location

  2. #2 peak

    Bartholomae translated as neck etc. of daevic beings (see DĒW), and mentioned manaoθrī- as the corresponding ahuric word (AirWb., cols. 530, 1

  3. #3 peak

    - Lifestyle & Culture⏎Kenya’s population is made up of over 40 different ethnic groups each with their own individual language, luckily English and Swahili is spoken by many.⏎Kenyan Tribes & People⏎Kenya is built

  4. #4 peak

    your chances in the no-holds-barred class, or on the roof.⏎Passengers were still pushing their way on board and trying to find somewhere to stow their endless boxes and bags of luggage when a bell clanged and we were off

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L2:2709 weakly excites
  2. L2:1906 weakly suppresses
  3. L0:178 weakly suppresses
  4. L2:876 weakly excites
  5. L0:1224 weakly suppresses
  6. L2:1717 weakly excites
  7. L2:2880 weakly suppresses
  8. L2:2837 weakly suppresses
  9. L1:2144 weakly excites
  10. L2:2426 weakly excites
  11. L2:2639 weakly suppresses
  12. L2:1273 weakly excites
  13. L0:4 weakly suppresses
  14. L1:87 weakly suppresses
  15. L2:1523 weakly excites
  16. L1:951 weakly excites
  17. L1:1029 weakly excites
  18. L2:2314 weakly suppresses
  19. L0:1755 weakly excites
  20. L1:190 weakly excites
  21. L0:1301 weakly suppresses
  22. L0:274 weakly excites
  23. L0:2406 weakly excites
  24. L0:1909 weakly excites

Feeds later layers

  1. L7:1521 excites
  2. L4:1775 excites
  3. L6:648 excites
  4. L8:2159 weakly excites
  5. L7:1218 weakly excites
  6. L4:2192 weakly excites
  7. L21:1246 weakly excites
  8. L27:2619 weakly excites
  9. L4:443 weakly excites
  10. L26:2507 weakly excites
  11. L18:710 weakly excites
  12. L17:1445 weakly excites
  13. L7:409 weakly excites
  14. L8:2293 weakly excites
  15. L5:541 weakly excites
  16. L26:2262 weakly excites
  17. L20:2148 weakly excites
  18. L23:3006 weakly excites
  19. L4:2604 weakly suppresses
  20. L25:160 weakly excites
  21. L23:1874 weakly excites
  22. L4:2817 weakly excites
  23. L7:755 weakly excites
  24. L25:2005 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.97 and -0.931 values between -0.70 and -0.661 values between -0.43 and -0.393 values between -0.39 and -0.349 values between -0.34 and -0.3026 values between -0.30 and -0.2555 values between -0.25 and -0.2194 values between -0.21 and -0.16175 values between -0.16 and -0.12334 values between -0.12 and -0.07732 values between -0.07 and -0.031124 values between -0.03 and 0.02783 values between 0.02 and 0.06307 values between 0.06 and 0.11139 values between 0.11 and 0.1555 values between 0.15 and 0.2031 values between 0.20 and 0.2414 values between 0.24 and 0.2911 values between 0.29 and 0.337 values between 0.33 and 0.381 values between 0.38 and 0.421 values between 0.47 and 0.511 values between 0.51 and 0.563 values between 0.78 and 0.83offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 摞
  2. ometric
  3. 表决
  4. 盖
  5. 患
  6. ABOVE
  7. Jude
  8. ushman
  9. iou
  10. erview

Suppresses

  1. 谊
  2. .TryGetValue
  3. responseObject
  4. .sendFile
  5. qw
  6. lưới
  7. buen
  8. polygon
  9. escort
  10. ỗi