Neuron Explorer

Qwen3-0.6B

"a" right after "as"

A neuron in layer 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "a" when it follows "as", as in "as a resurgent power", "as a tool" or "as a second language". Turning it up made the model repeat phrases, which doesn't clearly relate to this habit.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    The GIUK Gap forms the principal choke point between Russia’s great Northern Fleet and its strategic interests in the North Atlantic and all points south. The Russians, as a resurgent power, have modernized their military forces, but they still face the

  2. #2 peak

    contain redesigned genetic materials. Furthermore, they also give rise to redesigned biological systems, as a whole population/species is being altered or eliminated, thus changing the related ecosystems.

  3. #3 peak

    .)⏎In the dark all cats are gray. All persons are undistinguished till they have made a name.⏎Not room to swing a cat. Swinging cats as a mark for sportsmen was at one time a favourite amusement. There were several varieties

  4. #4 peak

    world’s largest and popular beaver dam, the Hover Dam at 1224 feet.⏎Dams are made with mud and stones by beavers as a protection against predators like wolves, bears and

  5. #5 peak

    Tutors and Students.⏎Biles, James J.; And Others⏎The guide is the second in a two-volume series designed to provide volunteer tutors of English as a Second Language (ESL) with skills and knowledge to individualize curricula and

  6. #6 peak

    observe it, we can learn so much” is the underlying philosophy of a number of innovative programmes being carried out in Uruguayan schools that are using gardens as a teaching resource, explained Edith Moraes, director of the national Primary Education

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: trees, birds, or animals. But the same names. So in the sky. So as in the sky. So as in the sky. So as in the sky. So in the sky. So in the sky. So as in

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    arks – Interactive Story Map.⏎Download these Missouri geologic maps to learn more about the diverse geology in the state.⏎These maps and others can be purchased by visiting us at 111 Fairgrounds Road in Rolla

  2. #2 peak

    these means the wisdom of “Father” Rosenkreuz, one hundred and twenty years after the latter’s burial, until about 16<|endoftext|>Gypsies have shared a common faith with Hungarians for many centuries. They put their talents,

  3. #3 peak

    , and sometimes-tumultuous American history ensued. But it got me thinking about the origin of the word thanksgiving and the fact that peoples of all nations have gathered through the ages to give thanks.⏎We don’t need to wait for blessings

  4. #4 peak

    ager and Amy Perry’s second grade classes presented poems, stories, songs, and jokes all involving trees.<|endoftext|>Obesity is

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L3:654 excites article 'a' after 'here are'
  2. L2:1977 suppresses
  3. L2:1426 excites
  4. L0:733 weakly excites
  5. L4:710 weakly excites
  6. L4:363 weakly excites
  7. L2:631 weakly suppresses
  8. L0:82 weakly excites
  9. L1:694 weakly suppresses
  10. L0:1256 weakly suppresses
  11. L1:2591 weakly excites
  12. L3:2707 weakly excites
  13. L3:976 weakly excites
  14. L2:1972 weakly suppresses
  15. L3:1172 weakly suppresses
  16. L0:2344 weakly excites
  17. L4:1579 weakly excites
  18. L0:406 weakly suppresses
  19. L0:39 weakly excites 'the' right after 'On' in 'On the other hand'
  20. L0:954 weakly excites
  21. L1:1288 weakly suppresses
  22. L2:1770 weakly suppresses
  23. L0:608 weakly excites
  24. L1:1165 weakly suppresses

Feeds later layers

  1. L7:146 strongly excites
  2. L6:1406 strongly excites
  3. L8:688 strongly excites
  4. L6:542 strongly excites
  5. L10:1476 strongly excites
  6. L7:385 strongly excites
  7. L7:327 strongly suppresses
  8. L6:1849 strongly excites
  9. L7:2115 strongly excites
  10. L8:1238 strongly excites
  11. L6:1734 strongly excites
  12. L16:1418 suppresses
  13. L6:410 suppresses
  14. L10:1190 suppresses
  15. L7:263 excites
  16. L10:661 excites
  17. L7:374 excites
  18. L7:257 excites
  19. L6:1655 excites "a" or "an" after "such" or launch verbs
  20. L9:439 suppresses
  21. L6:281 excites
  22. L16:2403 excites
  23. L6:415 excites
  24. L11:2798 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.72 and -2.621 values between -2.31 and -2.201 values between -2.20 and -2.103 values between -2.10 and -1.992 values between -1.99 and -1.892 values between -1.89 and -1.794 values between -1.79 and -1.683 values between -1.68 and -1.587 values between -1.58 and -1.4810 values between -1.48 and -1.379 values between -1.37 and -1.277 values between -1.27 and -1.1713 values between -1.17 and -1.0613 values between -1.06 and -0.9618 values between -0.96 and -0.8618 values between -0.86 and -0.7525 values between -0.75 and -0.6532 values between -0.65 and -0.5547 values between -0.55 and -0.4482 values between -0.44 and -0.34125 values between -0.34 and -0.23329 values between -0.23 and -0.13794 values between -0.13 and -0.031638 values between -0.03 and 0.08501 values between 0.08 and 0.18147 values between 0.18 and 0.2834 values between 0.28 and 0.3916 values between 0.39 and 0.494 values between 0.49 and 0.598 values between 0.59 and 0.705 values between 0.70 and 0.803 values between 0.80 and 0.902 values between 1.01 and 1.111 values between 1.11 and 1.222 values between 1.22 and 1.321 values between 1.32 and 1.42offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 这群
  2. ();)
  3. elves
  4. .Names
  5. 在一起
  6. eds
  7. 这些人
  8. 各有
  9. 姐妹
  10. closures

Suppresses

  1. ascal
  2. ểm
  3. lical
  4. anism
  5. циальн
  6. itzer
  7. angelo
  8. cursor
  9. handleMessage
  10. ết