Neuron Explorer

Qwen3-0.6B

'once' after was/were/have

A neuron in layer 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

The neuron fires on the word 'once' when it comes after a verb like 'was', 'were' or 'have' and means 'at some time in the past'. Turning it up made the model write more about past events and history.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    an Emperor/ress before the Shoguns took complete power. Samurai probably existed well before the appearance of Shoguns.⏎It is also known that there was once an ancient civilisation in the area pre<|endoftext|>- Herbert A. Simon was an

  2. #2 peak

    , I get excited about this.)<|endoftext|>It is supremely closed-minded to throw away Homer and Mozart and Augustine.⏎Professor, music historian and composer Robert Greenberg once received a letter from a musician urging him to give up the traditional and classical repertoire

  3. #3 peak

    the labor movement and I highly doubt many children even know why they are out of school. Many have no idea children were once forced into backbreaking jobs in mines, textiles, glass factories, canneries

  4. #4 peak

    instructions to his eldest son, Louis X⏎If God send thee adversity, receive it in patience and give<|endoftext|>In a remote part of the Olympic Peninsula there was once a tiny seaport community

  5. #5 peak

    thagoras travelled east beyond Egypt and came back with the notion (but they say this of Jesus too).] A later report claims he told followers that he has once been Aethalides,

  6. #6 peak

    “Bookends” couldn’t describe the decade of freedom and love better. What a time it was! Paul Kantner of “Jefferson Airplane” was once quoted as saying “If you can remember anything about the 60’s,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I think the first thing I need to do is to start the process of thinking and I need to be more careful about the symptoms, and the effects of the disease. The problem is that I need to be more careful about the symptoms,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    having the encrypted string is pointless. However, this does NOT provide any meaningful security against a determined attacker as it is rather trivial to open up the executable in a debugger and simply look at the decrypted information as the program runs. This is only meant

  2. #2 peak

    for validating expression of miRNAs in whole genome analyses such as microarray studies7. The samples used in this protocol were from patients who underwent radical prostatectomy for clinically localized prostate cancer; however other tissues and cell lines can be substituted in

  3. #3 peak

    million people and produced economic losses of more than $1 trillion. But the agency pointed out that efforts to better deal with disasters have begun to bear fruit: even as the number of disasters increased 4-fold, the number of fatalities decreased by nearly

  4. #4 peak

    panther’s last remaining core habitat area. It would facilitate development that would bring 300,000 additional residents into this rural region.⏎Even as the federal agency acknowledges the significance of this proposal,

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:1756 weakly suppresses
  2. L4:87 weakly excites
  3. L4:2846 weakly suppresses
  4. L2:84 weakly excites
  5. L3:2854 weakly excites
  6. L3:2103 weakly suppresses
  7. L3:1898 weakly excites
  8. L4:2570 weakly suppresses
  9. L1:2190 weakly excites
  10. L4:2725 weakly excites
  11. L3:2123 weakly excites
  12. L2:359 weakly suppresses
  13. L0:829 weakly excites
  14. L2:1176 weakly suppresses
  15. L3:2399 weakly excites
  16. L3:2100 weakly suppresses
  17. L1:2476 weakly excites
  18. L0:2888 weakly suppresses
  19. L2:680 weakly suppresses 'a' before a noun phrase
  20. L3:2345 weakly excites
  21. L4:1392 weakly suppresses
  22. L1:3052 weakly suppresses
  23. L4:1722 weakly suppresses unclear: word fragments inside names
  24. L0:2007 weakly suppresses 'key' after 'The'

Feeds later layers

  1. L8:1330 excites
  2. L7:2080 excites
  3. L6:1765 weakly suppresses
  4. L11:2653 weakly suppresses
  5. L14:1255 weakly excites
  6. L6:1492 weakly excites
  7. L11:2573 weakly excites
  8. L10:702 weakly excites
  9. L7:36 weakly suppresses
  10. L8:2859 weakly suppresses
  11. L23:1775 weakly suppresses
  12. L23:1777 weakly suppresses
  13. L25:626 weakly suppresses
  14. L12:2860 weakly suppresses
  15. L13:1760 weakly excites
  16. L15:2645 weakly suppresses
  17. L19:1271 weakly excites
  18. L7:2632 weakly excites
  19. L10:1357 weakly suppresses
  20. L13:2118 weakly suppresses
  21. L25:2915 weakly excites
  22. L8:2224 weakly excites
  23. L12:2419 weakly excites
  24. L9:2340 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.61 and -1.411 values between -1.02 and -0.829 values between -0.63 and -0.43162 values between -0.43 and -0.241340 values between -0.24 and -0.042081 values between -0.04 and 0.15274 values between 0.15 and 0.3524 values between 0.35 and 0.547 values between 0.54 and 0.741 values between 0.74 and 0.941 values between 0.94 and 1.132 values between 1.13 and 1.331 values between 1.52 and 1.721 values between 3.09 and 3.281 values between 3.48 and 3.671 values between 5.63 and 5.821 values between 6.02 and 6.22offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. agne
  2. atrás
  3. venting
  4. 不适合
  5. ��
  6. adders
  7. vably
  8. vin
  9. imension
  10. Suppress

Suppresses

  1. @\
  2. ties
  3. 用途
  4. textarea
  5. meantime
  6. zb
  7. סי
  8. feof
  9. Site
  10. trak