Neuron Explorer

Qwen3-0.6B

the letter r starting a word fragment

A neuron in layer 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to a separate 'r' at the start of a word that has been broken into pieces, such as 'ratiocinate', 'rangers' or 'rinds'. Turning it up made the writing wander and repeat phrases, so the output doesn't show a clear link to the trigger.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    proportion.⏎5. (n.) To exercise the rational faculty; to deduce inferences from premises; to perform the process of deduction or of induction; to ratiocinate; to reach conclusions

  2. #2 peak

    oxide, hydrofluorocarbons, perfluoroc<|endoftext|>Nowadays, in modern wineries, the remuage process is carried out using automated riddling machines.⏎These machines are a partial solution to the problem of the labour

  3. #3 peak

    or fees required.) While the main buildings of the sanitorium are located on the grounds of a publicly accessible state park, it should be noted that the park rangers are adamant about patrolling the area. Even with

  4. #4 peak

    through distillation.⏎Most citrus oils are produced using the cold-press method of extraction. The rinds are ground down and pressed mechanically, releasing a mixture of oil and liquid.⏎

  5. #5 peak

    help finance his expedition against Canada. In addition to helping public projects, lotteries are a popular form of gambling.⏎The purchase of a lottery ticket cannot be rationally accounted for by decision models based on expected value maximization, because the expected

  6. #6 peak

    101" introduces teenagers to outdoor fun—and helps instill some outdoor ethics and safety tips as part of the package.⏎The program began last year when rangers from Lake Mead teamed with the Southern Nevada Agency Partnership (SNAP)

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural natural

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    its time for colonial Southern California, and its extensive gardens were unique for the time period. Temple built the ranch house as a country home and headquarters for his cattle-ranching operation. Its

  2. #2 peak

    spp.) — muscadine⏎Greenbriar (smilax spp.)⏎Pokeweed (poke salad) —a forb or herbaceous plant⏎R<|endoftext|>While Blackboard is the dominant commercial learning management (LMS) for the

  3. #3 peak

    myra be rebuilt? And under what conditions? No sooner had Syrian forces and the Russian Army freed the "pearl of the desert," a spectacular Greco-Roman city with traces of Eastern influence, from the yoke of the Islamic State

  4. #4 peak

    reflection nebula comes from, nebula meaning “cloud” or “fog” in Latin.⏎space agencies described as “Like fog writhing around a street lamp,” but at this point, the cause of the

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L22:961 strongly suppresses
  2. L17:253 suppresses
  3. L16:113 excites
  4. L10:1473 suppresses
  5. L19:572 excites
  6. L2:19 suppresses
  7. L18:343 suppresses
  8. L17:420 suppresses
  9. L20:601 excites
  10. L0:1365 suppresses
  11. L23:1368 excites
  12. L7:286 excites
  13. L21:3031 excites
  14. L2:1866 suppresses
  15. L0:41 suppresses
  16. L19:1237 weakly excites
  17. L7:300 weakly excites
  18. L7:922 weakly excites
  19. L24:2266 weakly suppresses
  20. L20:257 weakly suppresses
  21. L1:32 weakly excites
  22. L10:232 weakly suppresses
  23. L17:892 weakly suppresses
  24. L25:1316 weakly suppresses

Feeds later layers

None: this is the last layer.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -37.81 and -32.423 values between -16.23 and -10.843 values between -10.84 and -5.44428 values between -5.44 and -0.053469 values between -0.05 and 5.352 values between 5.35 and 10.751 values between 37.72 and 43.121 values between 172.61 and 178.00offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. on
  2. 过去了
  3. ícia
  4. оро
  5. pheres
  6. AAD
  7. 想起来
  8. presente
  9. happened
  10. ieurs

Suppresses

  1. ho
  2. eta
  3. freopen
  4. apper
  5. elu
  6. olean
  7. emann
  8. esta
  9. .RestController
  10. etry