Neuron Explorer

Qwen3-0.6B

'that' after say, think and be sure

A neuron in layer 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word 'that' when it introduces a clause after words like 'says', 'I think' or 'I'm sure'. Its negative side is on crude slang and swear words. Turning it up made the replies wander without that theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    orer is not in Madison yet, but it's only a matter of time before it arrives here. We have a plan to deal with it."⏎Eddy says that plan was developed

  2. #2 peak

    The area of the iceberg spreads over 2,200 square miles, and the volume is 277 cubic miles. How large do you think that is?⏎You might be able to understand it better if the size is compared to

  3. #3 peak

    their meeting last month in Hanoi, Vietnam. “It’s actually not a bad idea,” Trump said. Kim answered through an interpreter, saying “I think that is something that could be welcomed.”⏎Sweden permitted a reporter

  4. #4 peak

    oak in mid-Missouri survived the Civil War and floods, but this summer's drought has taken a toll on the tree.⏎Landowner John Sam Williamson said that for the first time he can remember he had to haul water into the Missouri River

  5. #5 peak

    awesome) discovery. Without knowing too much about it, I’m sure that there will be a raft of problems involving the industrialization of a process like this

  6. #6 peak

    Van Honk speculates that the effect does not occur in cautious individuals, because the hormone would make them so paranoid that they would become socially disabled.⏎“I think that people are going to see that testosterone has beneficial effects on social behaviors and carries properties

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: A man, a woman, a man, a man, a man, a man... I'm a man. That's my day. I'm a man. I'm a man. I'm a man. That's my day.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    , T-dick, cock, dick, front hole, vag, boypussy, clitdick, balls, testes⏎- Back hole, arse, butt, bussy⏎- Breasts, chest, breast tissue, boobs

  2. #2 peak

    that the US has to send humans to Mars by 2030.” Space is about to get crowded, which means it’s even more important not to screw it up.⏎So Alexander’s panel recommends a few changes. Moving the Office of

  3. #3 peak

    entious: "Anything audacious and ambitious has a tincture of pretentiousness in it. Any less than arrogant composer must sometimes feel, ‘Who the hell am I to set forth this

  4. #4 peak

    I). However, it wasn’t until 1775 that Alexander Cummings added the u-bend and then 1858 and the Great Stink in London when things really took off. In response to the foul sewage problems of

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:1301 suppresses
  2. L2:1012 excites
  3. L1:788 weakly suppresses
  4. L2:2113 weakly suppresses
  5. L1:1779 weakly excites
  6. L0:178 weakly suppresses
  7. L2:75 weakly suppresses
  8. L0:1224 weakly suppresses
  9. L2:36 weakly excites
  10. L2:1964 weakly suppresses
  11. L2:2898 weakly suppresses
  12. L2:2809 weakly excites
  13. L2:1220 weakly suppresses
  14. L1:1689 weakly suppresses
  15. L1:1364 weakly suppresses
  16. L2:70 weakly excites
  17. L1:161 weakly suppresses
  18. L1:917 weakly excites
  19. L2:1321 weakly suppresses
  20. L0:2715 weakly excites
  21. L1:2337 weakly excites
  22. L1:2479 weakly suppresses
  23. L2:2638 weakly excites
  24. L2:2187 weakly excites

Feeds later layers

  1. L4:2329 suppresses
  2. L4:2276 suppresses
  3. L4:2550 weakly suppresses
  4. L6:2988 weakly excites
  5. L17:2846 weakly suppresses
  6. L12:2485 weakly excites
  7. L5:805 weakly suppresses
  8. L4:2746 weakly suppresses
  9. L11:690 weakly excites
  10. L5:1250 weakly excites
  11. L6:1234 weakly excites
  12. L9:2298 weakly excites
  13. L5:1716 weakly suppresses
  14. L26:794 weakly suppresses
  15. L21:2598 weakly excites
  16. L7:2563 weakly suppresses
  17. L5:495 weakly suppresses
  18. L10:845 weakly excites
  19. L9:775 weakly suppresses
  20. L4:1313 weakly suppresses
  21. L7:568 weakly suppresses
  22. L14:2254 weakly excites
  23. L15:2475 weakly excites
  24. L4:870 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.08 and -1.001 values between -0.63 and -0.552 values between -0.55 and -0.484 values between -0.48 and -0.416 values between -0.41 and -0.3323 values between -0.33 and -0.2688 values between -0.26 and -0.18240 values between -0.18 and -0.11678 values between -0.11 and -0.031260 values between -0.03 and 0.05853 values between 0.05 and 0.12454 values between 0.12 and 0.20199 values between 0.20 and 0.2766 values between 0.27 and 0.3517 values between 0.35 and 0.428 values between 0.42 and 0.501 values between 0.65 and 0.721 values between 1.02 and 1.091 values between 1.09 and 1.171 values between 1.17 and 1.241 values between 1.47 and 1.541 values between 1.54 and 1.622 values between 1.84 and 1.92offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 说着
  2. 铉
  3. 녕
  4. 鞘
  5. düş
  6. ected
  7. @section
  8. ображен
  9. jealous
  10. ollider

Suppresses

  1. .getError
  2. NavController
  3. 容器
  4. füh
  5. 泡
  6. [~,
  7. itory
  8. gulp
  9. kus
  10. urv