Neuron Explorer

Qwen3-0.6B

acronym endings like HSUS and SDS

A neuron in layer 3 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the last letters of capital-letter abbreviations, such as the 'US' in HSUS or the 'S' in SDS. It also goes strongly negative on weekday names in email date headers. Turning it up did not change the model's writing in a clear way.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    beagle saved from a Michigan research lab in 2019 after an HSUS undercover investigation at Charles River Laboratories, is now the namesake for important bipartisan legislation

  2. #2 peak

    very strong community of animal welfare advocates.⏎Molly Tamulevich, the HSUS⏎H.B. 4482 requires Michigan labs that use dogs and

  3. #3 peak

    processes related to WTO Agreements such as agriculture, sanitary and phytosanitary measures (SPS), technical barriers to trade (TBT), trade-related aspects of intellectual property rights

  4. #4 peak

    . Temperature range⏎4. Temperature display accuracy⏎5. Temperature stability⏎6. Temperature uniformity⏎7. Heating time⏎8. Internal material⏎SUS304 stainless steel plate, thickness 1.2

  5. #5 peak

    wireless (not all warnings sent to the ship reached the bridge, and a nearby ship, the operator abed, missed Titanic's SOS). Very recently, from recovered wreckage, "Popular Science" claimed the hull was

  6. #6 peak

    the entire tree until you see that there is little chance that the tree will<|endoftext|>Safety Data Sheet Information⏎Employers must ensure that the Safety Data Sheet (SDSs) are readily accessible to employees for all hazardous chemicals in their workplace. This

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I had a few weeks with a few months, and I have been thinking about it in the past. I am currently working on a few days. I have been working on it. I have been working on a few days. I have

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    chemistryFri, 3 Sep 2010, 12:51:40 EDT⏎- Martian rock arrangement not alien handiworkWed, 7 Jan 2009, 13:

  2. #2 peak

    . // in Elliot Hildner / University of Bremen⏎The main crack<|endoftext|>analysis of algoritms⏎robert.kern at gmail.com⏎Fri Sep 10 00:10:22 CEST 2

  3. #3 peak

    4 + 314 = 512<|endoftext|>[Haskell-beginners] Question about data structures⏎daniel.is.fischer at web.de⏎Wed Nov

  4. #4 peak

    have been clear enough. ------------------ Come on in !! Drinks are on the house in the Big Moose Saloon !!⏎Udayan Naik<BR>Sun Certified Programmer for the Java <|endoftext|>Australia takes about 13 00

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:178 weakly suppresses
  2. L1:2115 weakly suppresses
  3. L0:1224 weakly suppresses
  4. L2:49 weakly suppresses
  5. L0:1301 weakly suppresses
  6. L0:2913 weakly excites
  7. L2:75 weakly suppresses
  8. L1:1029 weakly excites
  9. L0:188 weakly excites
  10. L2:1657 weakly excites
  11. L2:2009 weakly excites
  12. L2:84 weakly excites
  13. L2:493 weakly suppresses
  14. L2:1321 weakly suppresses
  15. L0:1329 weakly suppresses
  16. L2:1288 weakly suppresses
  17. L0:2476 weakly excites
  18. L2:1874 weakly excites
  19. L2:57 weakly suppresses
  20. L1:2234 weakly suppresses
  21. L0:1822 weakly suppresses
  22. L0:2675 weakly suppresses
  23. L2:70 weakly excites
  24. L0:732 weakly excites

Feeds later layers

  1. L4:2984 suppresses
  2. L7:2828 weakly suppresses
  3. L13:1373 weakly excites
  4. L16:139 weakly excites
  5. L16:135 weakly excites
  6. L18:2668 weakly excites
  7. L22:1127 weakly excites machine learning explanations, mid-sentence
  8. L16:898 weakly excites
  9. L24:796 weakly excites
  10. L16:439 weakly excites
  11. L4:1991 weakly excites
  12. L5:1452 weakly suppresses "Al-Aqsa" and "Lunar Module" name parts
  13. L19:1633 weakly excites
  14. L27:546 weakly suppresses
  15. L14:1220 weakly suppresses
  16. L18:1956 weakly excites
  17. L9:410 weakly suppresses
  18. L14:330 weakly suppresses
  19. L5:2405 weakly excites
  20. L16:1380 weakly excites
  21. L5:1155 weakly excites
  22. L5:3060 weakly excites
  23. L23:1287 weakly excites
  24. L21:2829 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.28 and -1.191 values between -0.73 and -0.641 values between -0.64 and -0.552 values between -0.55 and -0.466 values between -0.46 and -0.3624 values between -0.36 and -0.2777 values between -0.27 and -0.18311 values between -0.18 and -0.091190 values between -0.09 and 0.001487 values between 0.00 and 0.09554 values between 0.09 and 0.18178 values between 0.18 and 0.2847 values between 0.28 and 0.3719 values between 0.37 and 0.464 values between 0.46 and 0.551 values between 0.55 and 0.642 values between 0.82 and 0.911 values between 1.55 and 1.641 values between 2.01 and 2.101 values between 2.28 and 2.37offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ilha
  2. AGO
  3. UNC
  4. amura
  5. انية
  6. гла
  7. eenth
  8. Order
  9. onte
  10. elsen

Suppresses

  1. 组织实施
  2. UIGraphics
  3. 这套
  4. 政法
  5. getDefault
  6. itional
  7. '";⏎
  8. .opens
  9. couldn
  10. .createTextNode