Neuron Explorer

Qwen3-0.6B

"are" starting a sentence after "There"

A neuron in layer 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word "are" in the phrase "There are", especially when it opens a new answer or sentence. When it was turned up, the model's replies did not visibly change in a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    How to Control the Redbay Ambrosia Beetle⏎There are no tested or proven treatments for<|endoftext|>This page is a blog post that explains what

  2. #2 peak

    explicitly state that apostates should be killed.⏎There are a number of different interpretations of these verses and hadith, and there is much

  3. #3 peak

    how are these numbers obtained? And wouldn’t everything feature UPF50+?⏎There are several factors that help determine the UPF level. Fabric content, color, weight

  4. #4 peak

    different ways that coffee can be brewed.⏎There are two main types of coffee plants. The Coffea arabica, the most common

  5. #5 peak

    Can I swim with a waterproof hearing aid?⏎There are currently no hearing aids recommended for swimming. A hearing aid manufacturer offered a swimm

  6. #6 peak

    you’re looking for ways to take your business to the next level, then don’t hesitate to explore AI options!⏎The Benefits Of AI In Blogging⏎There are many benefits to using AI in blogging. For example, automated content generation can save

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have to have thought about this, and I have to have thought about this, and I have to have thought about this. I have to have thought about this, and I have to have thought about this, and I have to have

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    the district courts located?⏎There are 48 district courts spread out over the whole of Sweden, from Ystad in the south to Gällivare in the north. These vary in size from having several hundred to ten or so

  2. #2 peak

    in the Dutch city of Middelburg in the hands of Hans Lippershey and Zacharias Janssen.⏎A French astronomer, Jacques Bovedere, said the possible applications of the Magnifier tube in the astronomical field in letter

  3. #3 peak

    to continue to be used in New Zealand – as it has for over 20 years already.<|endoftext|>Pushlets - Whitepaper⏎Author: Just van den Broecke⏎Date: August 6, 2002⏎Push

  4. #4 peak

    ains in Donegal, ruling west Ulster with the O'Donnells and the O'Doughertys. Boyles can also be found in Kildare and Offaly. BOYLE is one of 50 common Irish surn

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:1301 suppresses
  2. L0:178 suppresses
  3. L0:1224 suppresses
  4. L0:1910 excites
  5. L0:1332 weakly suppresses
  6. L0:1 weakly suppresses
  7. L0:799 weakly suppresses
  8. L0:458 weakly suppresses
  9. L0:775 weakly suppresses
  10. L0:1609 weakly excites
  11. L0:1988 weakly excites
  12. L0:333 weakly excites
  13. L0:708 weakly excites
  14. L0:556 weakly suppresses
  15. L0:1108 weakly suppresses
  16. L0:1999 weakly excites
  17. L0:1167 weakly suppresses
  18. L0:1931 weakly suppresses
  19. L0:890 weakly excites
  20. L0:1787 weakly suppresses
  21. L0:2367 weakly suppresses
  22. L0:3014 weakly suppresses
  23. L0:1142 weakly suppresses
  24. L0:2726 weakly excites

Feeds later layers

  1. L23:2230 excites
  2. L16:1330 excites
  3. L7:2025 weakly excites
  4. L7:651 weakly excites
  5. L18:1506 weakly suppresses
  6. L6:156 weakly excites
  7. L25:1416 weakly excites
  8. L24:937 weakly suppresses
  9. L16:2519 weakly excites
  10. L21:1768 weakly suppresses
  11. L27:3023 weakly suppresses
  12. L4:2236 weakly excites
  13. L5:2120 weakly suppresses
  14. L10:624 weakly excites
  15. L17:1524 weakly excites
  16. L4:2440 weakly suppresses
  17. L2:1002 weakly excites
  18. L5:3061 weakly suppresses
  19. L24:1377 weakly suppresses
  20. L3:1426 weakly suppresses
  21. L5:318 weakly suppresses
  22. L3:968 weakly suppresses
  23. L15:1438 weakly suppresses
  24. L27:1137 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -0.67 and -0.4493 values between -0.44 and -0.222257 values between -0.22 and 0.011503 values between 0.01 and 0.2337 values between 0.23 and 0.464 values between 0.46 and 0.686 values between 0.68 and 0.911 values between 1.13 and 1.361 values between 1.36 and 1.581 values between 1.58 and 1.811 values between 3.16 and 3.392 values between 8.12 and 8.34offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. many
  2. YT
  3. gt
  4. pard
  5. 限期
  6. るもの
  7. 弄
  8. Outstanding
  9. pl
  10. ultipart

Suppresses

  1. 们都
  2. aneously
  3. ingly
  4. ольз
  5. 骼
  6. efeller
  7. "-";⏎
  8. ==$
  9. zeitig
  10. edImage