'w' inside split words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the letter w when it sits in the middle of a word that was cut into pieces, such as the w in Kaswera or swimming. When it was turned down, the model repeated phrases like all things, and when turned up the text became unrelated.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ocarpus incisa_); Fabrics of beaten bark (_kapa_) and fibre of the _olona_ (_Boehmeria_), of _wau
-
the issues that arose in Congo — and solutions that gave family members peace of mind as well as more faith in the health-care establishment.⏎When Marie Jeanne Kaswera lost her husband to Ebola at the start of the devastating epidemic in the Democratic
-
ssonetia, kapa, 1, and tapa.⏎Sorry, no etymologies found.⏎He goes to Kaupo and changes into the _wauke_ plant.⏎_Kapa_, a kind of large sheet in which the
-
, family and neighbors from paying him their final respect, as is required in her country's custom.⏎"I was very hurt," says Kaswera, who was unable to attend her husband's funeral or perform any burial rituals
-
.⏎- In the afternoons we learn different subjects such as Science, Geography, History, Art, Music, DT, PE and RE.⏎- PE/Swimming is currently on Mondays.⏎- Each child is allocated two or reading books each
-
mortification or humility before Allah (swt) and during the situations of calamity and catastrophe, wailing is the act of the praised ones and since ‘wailing’ is a composite act of mourning it serves as evidence for mourning.⏎C
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: allwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and a range of other species that are far less suited to more open habitats.⏎Red Squirrels, too, thrive in conifer woodland, with native pinewoods supporting the highest densities. Within plantations, Sitka Spruce is not
-
high standards⏎Perfectionists set unrealistic standards for tasks they do. Often, the said task doesn’t even require much effort. But for them, their self-worth depends on how perfect their result is. Therefore, they tend to overwork
-
mg/kg per day. Riboflavin⏎at 50 to 750 mg daily is recommended. Fasting should be avoided.⏎OF CARBOHYDRATE METABOLISM⏎due to an inborn error in the
-
sandy, and dry soil. Prefers full sun.⏎Bloom Time: Late, July-Sep⏎Bloom Color: White⏎Benefit to pollinators/wildlife: Special value to native bees as well as butterflies.⏎Native Status:
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:2646 strongly excites
- L20:417 excites
- L19:974 suppresses
- L18:533 suppresses
- L21:1052 excites mid-word 'electro' and 'ro' fragments
- L0:3043 weakly suppresses
- L21:463 weakly suppresses
- L7:2731 weakly suppresses
- L18:569 weakly excites
- L22:530 weakly suppresses
- L23:2981 weakly suppresses
- L17:1717 weakly excites
- L18:112 weakly suppresses 'over' meaning time or duration
- L19:217 weakly suppresses
- L4:610 weakly suppresses
- L19:1370 weakly excites
- L16:177 weakly excites zero digit inside dates and codes
- L6:16 weakly excites
- L12:2249 weakly excites
- L15:1272 weakly suppresses
- L20:1120 weakly excites
- L16:66 weakly suppresses
- L9:189 weakly suppresses
- L18:576 weakly suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- v
- independently
- vj
- quirrel
- edo
- ographed
- 次要
- уль
- icamente
- os
Suppresses
- ww
- ise
- all
- rite
- ords
- dish
- asher
- ater
- equality
- indow