Neuron Explorer

Qwen3-0.6B

subject then was/been before a past participle

A neuron in layer 24 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

The neuron fires on the helper word right after a person or subject, such as 'he was appointed', 'you have been told', or 'has been a member'. Steering did not give a clear theme when it was turned up, so the effect on the text is hard to read.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    You might also be given anti-platelets if you have had a stent fitted to a narrowed artery, if you’ve had a stroke or if you’ve been diagnosed with peripheral vascular disease. The most common anti-platelet drug used in

  2. #2 peak

    by uncles, he enrolled at age seventeen in the Royal Academy of Painting and Sculpture. He was not an outstanding student, and tried four times before he was awarded the Prix de Rome in 1774 which permitted him to go

  3. #3 peak

    immediately preceding election or appointment. One must also be at least twenty-five years old upon assuming office. No person can serve as attorney general unless he or she has been an active member of the State Bar of Georgia for at least seven years.⏎The

  4. #4 peak

    If you have any problems with the way your kidneys work, or with the way your liver works.⏎- If you have a heart condition.⏎- If you have been told you have low levels of sodium in your blood.⏎- If you have a

  5. #5 peak

    editions and was described by Sir Walter Scott as “a “very beautiful piece.”Cartwright was marked down for the church and in 1772 he was appointed curate of Brampton, near Wakefield, moving, seven years later

  6. #6 peak

    one of the great innovative and creative geniuses of the Japanese woodblock print. At the age of eleven, he was enrolled as a student of the school of Kuniyoshi. His early work

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the potential for a negative impact of the "Ries Ries" (inieoties) in the form of "aginaginagag" in the form of aagagagagagagagagagagag

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    of foreign goods, strong patriotism and high availability of domestic brands. If consumers believe that foreign goods are generally inferior to their own home goods, then they will be less likely to support foreign brands. These consumers also are aware of economic conditions and want

  2. #2 peak

    Check how much information about you is available on the internet, why not type your name into a search engine and see how many hits you get.⏎- Don't be lulled into a false sense of security, online 'friends' may not be

  3. #3 peak

    cause the phone to burn out or cause internal circuit damage. Pengo is here to remind the readers to pay more attention when selecting power banks! Also don't be greedy and cheap, you get what you paid for.⏎Ampere is the

  4. #4 peak

    iating the resulting intergovernmental relationships among the Indian nations, the United States, and the states of the Union.” Cohen’s Handbook of Federal Indian Law (Nell Jessup Newton et al., eds., LexisNexis 20

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L21:2519 suppresses
  2. L22:550 suppresses
  3. L23:623 weakly excites
  4. L1:460 weakly excites
  5. L21:279 weakly excites
  6. L19:1115 weakly excites
  7. L5:8 weakly excites
  8. L9:66 weakly excites
  9. L14:1211 weakly excites
  10. L19:2879 weakly suppresses
  11. L21:768 weakly excites
  12. L20:49 weakly suppresses
  13. L6:2201 weakly excites
  14. L17:2353 weakly excites
  15. L16:2038 weakly suppresses
  16. L19:2007 weakly excites
  17. L21:1233 weakly excites
  18. L22:349 weakly suppresses
  19. L5:2182 weakly suppresses
  20. L22:1227 weakly suppresses
  21. L19:1373 weakly suppresses
  22. L16:2027 weakly suppresses
  23. L11:604 weakly suppresses
  24. L23:1131 weakly excites

Feeds later layers

  1. L27:2060 weakly excites
  2. L25:2664 weakly suppresses
  3. L25:2909 weakly excites
  4. L25:1164 weakly suppresses
  5. L25:1901 weakly suppresses
  6. L27:1345 weakly excites
  7. L25:720 weakly excites
  8. L27:1008 weakly excites
  9. L25:2830 weakly suppresses
  10. L26:2805 weakly excites
  11. L25:1952 weakly suppresses
  12. L25:2473 weakly excites
  13. L27:2694 weakly suppresses
  14. L26:941 weakly suppresses
  15. L26:2447 weakly excites
  16. L26:2164 weakly excites
  17. L26:2258 weakly excites
  18. L26:2917 weakly suppresses
  19. L26:2017 weakly excites
  20. L25:733 weakly suppresses
  21. L25:2239 weakly suppresses
  22. L25:2245 weakly excites
  23. L26:1334 weakly suppresses
  24. L25:2103 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

3 values between -12.81 and -11.285 values between -11.28 and -9.768 values between -9.76 and -8.2416 values between -8.24 and -6.7225 values between -6.72 and -5.2039 values between -5.20 and -3.6866 values between -3.68 and -2.15341 values between -2.15 and -0.632918 values between -0.63 and 0.89266 values between 0.89 and 2.4172 values between 2.41 and 3.9350 values between 3.93 and 5.4629 values between 5.46 and 6.9810 values between 6.98 and 8.5015 values between 8.50 and 10.028 values between 10.02 and 11.546 values between 11.54 and 13.065 values between 13.06 and 14.593 values between 14.59 and 16.113 values between 16.11 and 17.637 values between 17.63 and 19.151 values between 19.15 and 20.674 values between 22.19 and 23.722 values between 23.72 and 25.242 values between 25.24 and 26.761 values between 26.76 and 28.281 values between 34.37 and 35.891 values between 35.89 and 37.411 values between 46.54 and 48.06offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. released
  2. 推向
  3. zem
  4. archy
  5. nym
  6. 釋
  7. SHIP
  8. promoted
  9. approved
  10. admitted

Suppresses

  1. uite
  2. utsch
  3. ulence
  4. punct
  5. ride
  6. egative
  7. уль
  8. rite
  9. unger
  10. uchen