Neuron Explorer

Qwen3-0.6B

'fl' and 're' word starts

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the start of some words, most clearly 'fl' in flutters, flaking and flit. It goes the other way on 're' at the start of words like re-education or self-repair. Turning it up made the model keep saying 'refresh', which matches what the neuron seems to push toward.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    feather at the same time… which one hits the ground first?⏎- Obviously, common sense will tell you that the bar will hit first, while the feather slowly flutters to the ground.⏎- In Aristotle’s view, this was because the bar

  2. #2 peak

    to the plant, the faster the rate of photosynthesis - if other factors are favourable.⏎Plant respiration captures CO2.⏎Unlike photosynhesis, plant respiration captures atmospheric oxygen and releases carbon dioxide.⏎The rate of respiration decreases with

  3. #3 peak

    that causes skin cells to grow at a faster rate than normal, resulting in thick white, silver or red patches of skin. Under normal circumstances skin cells grow and flake off after every four weeks. However, in the case of psoriasis new

  4. #4 peak

    1 cup lard) then heating and stirring over moderate heat⏎until the desired color is achieved (overheating will cause it to lose its⏎red color<|endoftext|>How would you classify someone who is morbidly

  5. #5 peak

    out if it:⏎- changes shape or looks uneven.⏎- changes colour, gets darker or has more than 2 colours.⏎- starts itching, crusting, flaking or bleeding.⏎- gets larger or more raised from the skin.⏎What do

  6. #6 peak

    in the sky - It's a bird! It's a plane! It's a ... hummingbird!⏎Those fragile-looking little flecks of light and noise that flit to and fro are not nearly as delicate as they might seem. Looking like

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: when you think of social organizations, you think of family, family organizations, family organizations refreddo, family refreddo refreddo, family refreddo refreddo refreddo refreddo refreddo refreddo

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    be noted that during the process of clearing the body of toxins, the liver is damaged by exposure to harmful substances. The liver therefore possesses the amazing ability to self-repair and regenerate of damaged tissues.⏎So as one can plainly see, proper liver

  2. #2 peak

    few days following.⏎80-90% of people with a concussion make a complete recovery within 1-4 weeks. The recovery occurs as the brain re-calibrates after using an excessive amount of energy following the initial impact. Therefore

  3. #3 peak

    when this Electrical nerve stimulation treatment is given regularly.⏎Benefits of Ultrasound Therapy⏎- Re-education of Muscle contractions⏎- Increase in blood flow⏎- Maintenance of

  4. #4 peak

    war would last less than four months, but saw the downfall of the Spanish Empire and the rise of America as a major world power with several new possessions.⏎Britain Repeals the Stamp Act⏎On March 18, 176

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L2:239 weakly excites
  2. L22:2630 weakly suppresses
  3. L18:103 weakly excites
  4. L5:2200 weakly excites
  5. L10:2918 weakly excites
  6. L19:244 weakly excites
  7. L2:964 weakly excites
  8. L0:2886 weakly excites
  9. L21:346 weakly excites
  10. L16:19 weakly excites
  11. L4:1981 weakly suppresses
  12. L3:929 weakly suppresses
  13. L16:145 weakly suppresses
  14. L10:5 weakly suppresses
  15. L6:1742 weakly excites
  16. L3:667 weakly excites
  17. L20:1983 weakly excites
  18. L6:2778 weakly excites
  19. L21:1663 weakly excites
  20. L4:2532 weakly suppresses surname pieces split across tokens
  21. L9:2216 weakly suppresses
  22. L3:232 weakly suppresses 'on' after a noun like 'impact on'
  23. L5:50 weakly excites
  24. L21:2570 weakly suppresses

Feeds later layers

  1. L27:1600 weakly excites
  2. L27:2902 weakly suppresses
  3. L27:2525 weakly excites
  4. L27:1072 weakly suppresses
  5. L27:3004 weakly excites
  6. L27:1068 weakly excites
  7. L27:1700 weakly suppresses
  8. L27:2775 weakly suppresses
  9. L27:1424 weakly excites
  10. L27:855 weakly excites
  11. L27:2332 weakly excites
  12. L27:1325 weakly excites
  13. L27:403 weakly excites
  14. L27:2728 weakly excites
  15. L27:476 weakly suppresses
  16. L27:2392 weakly excites
  17. L27:2173 weakly suppresses
  18. L27:2649 weakly excites
  19. L27:893 weakly suppresses
  20. L27:1641 weakly excites
  21. L27:2204 weakly suppresses
  22. L27:1554 weakly excites
  23. L27:2562 weakly suppresses
  24. L27:2897 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

3 values between -21.05 and -19.852 values between -18.66 and -17.461 values between -17.46 and -16.261 values between -16.26 and -15.071 values between -15.07 and -13.872 values between -12.68 and -11.482 values between -11.48 and -10.295 values between -10.29 and -9.095 values between -9.09 and -7.898 values between -7.89 and -6.7010 values between -6.70 and -5.5017 values between -5.50 and -4.3113 values between -4.31 and -3.1151 values between -3.11 and -1.92201 values between -1.92 and -0.723058 values between -0.72 and 0.48368 values between 0.48 and 1.6771 values between 1.67 and 2.8732 values between 2.87 and 4.0621 values between 4.06 and 5.269 values between 5.26 and 6.456 values between 6.45 and 7.653 values between 7.65 and 8.855 values between 8.85 and 10.043 values between 10.04 and 11.242 values between 11.24 and 12.433 values between 13.63 and 14.821 values between 14.82 and 16.021 values between 17.22 and 18.411 values between 20.80 and 22.002 values between 25.59 and 26.78offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. refresh
  2. refresh
  3. baths
  4. Refresh
  5. Refresh
  6. .Refresh
  7. marine
  8. arks
  9. _refresh
  10. refreshed

Suppresses

  1. redd
  2. chy
  3. ez
  4. 尺
  5. GOR
  6. emin
  7. Zero
  8. zero
  9. 配偶
  10. winding