Neuron Explorer

Qwen3-0.6B

the letter f starting a word

A neuron in layer 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the letter f when it begins a word, like the f in fountains, flossing or firs. Turning it up mostly made the model's text fall into repeated loops rather than producing anything about f.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    through professional art design, you can draw a beautiful aquatic landscape.⏎In addition, different creative fountain forms are suitable for different application scenarios. For example, music creative fountains are generally suitable for meeting places such as squares. It is an organic combination

  2. #2 peak

    Older people who have used hearing aids will remember the days when the only way to change the settings on your hearing aid was to break out a screwdriver and fiddle around with the device. Even then, there were only a few different things

  3. #3 peak

    .⏎How to Take Care of Your Teeth with Braces⏎When you have braces, you'll have to be very good about following the brushing and flossing instructions your orthodontist gives you.⏎You can't eat hard,

  4. #4 peak

    offensive vapors are scrubbed or adsorbed before the exit gases are released into the hood exhaust system (see section 8.C.8.1 on fume hood scrubbers).⏎It is necessary to check if the hoods are performing

  5. #5 peak

    species than to others. In choice of nesting sites it exhibits a wide range of taste, and nests have been found in scrub oaks, pines, and firs, and varying in height from the ground from 3 or 4 feet

  6. #6 peak

    first time you ever hear of these things are when you see your hygienist. Did you also know that when your hygienist tells you to brush and floss more, it’s because this is the best way to prevent and treat these

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: Ifineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineineine

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    : territorial approach. Mechanical rules lead to certainty/predictability, but don’t take into account justice/fairness.⏎1. 10 states still follow Beale.⏎iii.

  2. #2 peak

    in cold-water fish.⏎- Steer clear of trans-fatty acids, which are found in deep-fried foods, margarine, and

  3. #3 peak

    Holy Spirit, who thus keeps the memory of Christ alive in his Church at prayer, also leads her toward the fullness of truth and inspires new formulations expressing the unfathomable mystery of Christ at work in his Church's life, sacraments,

  4. #4 peak

    Great Unknown: Risk-Taking Behavior in Adolescents⏎19.01.2017 | Max-Planck-Institut für Bildungsforschung⏎A sudden drop in outdoor temperature increases the risk of respiratory infections⏎

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L22:369 excites
  2. L18:437 excites
  3. L23:2441 excites
  4. L19:702 excites
  5. L2:1622 excites
  6. L18:328 suppresses
  7. L20:211 excites
  8. L0:755 suppresses
  9. L5:890 excites
  10. L18:569 excites
  11. L26:1564 excites
  12. L9:449 suppresses
  13. L17:378 weakly excites
  14. L24:586 weakly excites
  15. L20:1120 weakly excites
  16. L22:2428 weakly excites
  17. L5:91 weakly excites
  18. L21:2842 weakly excites
  19. L4:1892 weakly excites
  20. L16:2450 weakly suppresses
  21. L1:1464 weakly excites
  22. L21:237 weakly suppresses
  23. L1:951 weakly excites
  24. L23:206 weakly suppresses

Feeds later layers

None: this is the last layer.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -70.81 and -67.531 values between -24.85 and -21.571 values between -18.29 and -15.011 values between -11.72 and -8.445 values between -5.16 and -1.873889 values between -1.87 and 1.415 values between 1.41 and 4.691 values between 4.69 and 7.981 values between 7.98 and 11.262 values between 11.26 and 14.541 values between 57.22 and 60.50offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. soever
  2. fs
  3. aked
  4. fed
  5. Hats
  6. flashes
  7. 一起
  8. .PNG
  9. bart
  10. fasta

Suppresses

  1. ine
  2. resh
  3. �
  4. безопас
  5. rax
  6. inely
  7. #pragma
  8. ulling
  9. Pub
  10. inding