Neuron Explorer

Qwen3-0.6B

'w' inside split words

A neuron in layer 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the letter w when it sits in the middle of a word that was cut into pieces, such as the w in Kaswera or swimming. When it was turned down, the model repeated phrases like all things, and when turned up the text became unrelated.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    ocarpus incisa_); Fabrics of beaten bark (_kapa_) and fibre of the _olona_ (_Boehmeria_), of _wau

  2. #2 peak

    the issues that arose in Congo — and solutions that gave family members peace of mind as well as more faith in the health-care establishment.⏎When Marie Jeanne Kaswera lost her husband to Ebola at the start of the devastating epidemic in the Democratic

  3. #3 peak

    ssonetia, kapa, 1, and tapa.⏎Sorry, no etymologies found.⏎He goes to Kaupo and changes into the _wauke_ plant.⏎_Kapa_, a kind of large sheet in which the

  4. #4 peak

    , family and neighbors from paying him their final respect, as is required in her country's custom.⏎"I was very hurt," says Kaswera, who was unable to attend her husband's funeral or perform any burial rituals

  5. #5 peak

    .⏎- In the afternoons we learn different subjects such as Science, Geography, History, Art, Music, DT, PE and RE.⏎- PE/Swimming is currently on Mondays.⏎- Each child is allocated two or reading books each

  6. #6 peak

    mortification or humility before Allah (swt) and during the situations of calamity and catastrophe, wailing is the act of the praised ones and since ‘wailing’ is a composite act of mourning it serves as evidence for mourning.⏎C

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: allwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    and a range of other species that are far less suited to more open habitats.⏎Red Squirrels, too, thrive in conifer woodland, with native pinewoods supporting the highest densities. Within plantations, Sitka Spruce is not

  2. #2 peak

    high standards⏎Perfectionists set unrealistic standards for tasks they do. Often, the said task doesn’t even require much effort. But for them, their self-worth depends on how perfect their result is. Therefore, they tend to overwork

  3. #3 peak

    mg/kg per day. Riboflavin⏎at 50 to 750 mg daily is recommended. Fasting should be avoided.⏎OF CARBOHYDRATE METABOLISM⏎due to an inborn error in the

  4. #4 peak

    sandy, and dry soil. Prefers full sun.⏎Bloom Time: Late, July-Sep⏎Bloom Color: White⏎Benefit to pollinators/wildlife: Special value to native bees as well as butterflies.⏎Native Status:

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L22:2646 strongly excites
  2. L20:417 excites
  3. L19:974 suppresses
  4. L18:533 suppresses
  5. L21:1052 excites mid-word 'electro' and 'ro' fragments
  6. L0:3043 weakly suppresses
  7. L21:463 weakly suppresses
  8. L7:2731 weakly suppresses
  9. L18:569 weakly excites
  10. L22:530 weakly suppresses
  11. L23:2981 weakly suppresses
  12. L17:1717 weakly excites
  13. L18:112 weakly suppresses 'over' meaning time or duration
  14. L19:217 weakly suppresses
  15. L4:610 weakly suppresses
  16. L19:1370 weakly excites
  17. L16:177 weakly excites zero digit inside dates and codes
  18. L6:16 weakly excites
  19. L12:2249 weakly excites
  20. L15:1272 weakly suppresses
  21. L20:1120 weakly excites
  22. L16:66 weakly suppresses
  23. L9:189 weakly suppresses
  24. L18:576 weakly suppresses

Feeds later layers

None: this is the last layer.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -119.38 and -115.171 values between -52.08 and -47.871 values between -35.25 and -31.041 values between -31.04 and -26.841 values between -22.63 and -18.432 values between -14.22 and -10.011 values between -10.01 and -5.815 values between -5.81 and -1.603887 values between -1.60 and 2.614 values between 2.61 and 6.813 values between 6.81 and 11.021 values between 44.67 and 48.88offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. v
  2. independently
  3. vj
  4. quirrel
  5. edo
  6. ographed
  7. 次要
  8. уль
  9. icamente
  10. os

Suppresses

  1. ww
  2. ise
  3. all
  4. rite
  5. ords
  6. dish
  7. asher
  8. ater
  9. equality
  10. indow