first letters fl, w and ew
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the first piece of a split word, especially the starts "fl", "w" and "ew" as in "flautists", "flutters" and "servicewoman". It is negative on the capital first letter of a sentence or list item, like "Lacking" or "Washing". Steering produced unrelated text, so it does not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
many are already included.⏎The last ferry-boat was swept downstream in a flood. It had been in use until that day.⏎Seven servicemen and one servicewoman were killed during the war. The War Memorial lists the names of all those
-
dancer, a dance teacher, the composers of verses, the musicians including drummers, flautists and yal players and their uses are set out clearly. According to Ill
-
for a ride to demonstrate how easy it was to spot forest fires by air.” Impressed, Griffith had the Wisconsin Conservation Commission appoint Vilas as a flying fire warden, the first in the world. Vilas flew his surveillance missions from the
-
Web - Is both an⏎excellent bibliography and guide to online resources.⏎Breakthroughs for Black Military Women⏎- Traces the path of African-American servicewomen to full military⏎participation in timeline format.⏎Brief History of Black Women
-
in the sky - It's a bird! It's a plane! It's a ... hummingbird!⏎Those fragile-looking little flecks of light and noise that flit to and fro are not nearly as delicate as they might seem. Looking like
-
feather at the same time… which one hits the ground first?⏎- Obviously, common sense will tell you that the bar will hit first, while the feather slowly flutters to the ground.⏎- In Aristotle’s view, this was because the bar
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Bececececececececececececececececececececececececececececececececececececececececececececececece
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
diet containing about 0.6–0.8 grams of protein per lb, may help with appetite control, and improve your body’s composition.⏎4. Lacking fiber in your diet⏎Adding enough fiber to your meal can
-
needs to have the right level of thickness (not too pasty, or too runny – like milk). In addition, a perfect version shouldn’t contain any lumps.⏎This recipe will show you exactly how to make a flawless white sauce of
-
form, warm water will also start to “cook” the outside of the meat before the middle is thawed).⏎Why shouldnt you soak chicken in water?⏎Washing raw chicken before cooking it can increase your risk of food poisoning from campy
-
psychological stress. In other children, symptoms gradually accumulate over time with no single triggering event.⏎In children with fibromyalgia, signs and symptoms include:⏎- Widespread pain. The pain associated with fibromyalgia often is described as
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:202 suppresses
- L23:166 excites
- L18:778 suppresses
- L21:437 excites
- L20:565 suppresses
- L24:2164 excites
- L9:449 suppresses
- L22:2646 weakly excites
- L20:2710 weakly excites
- L20:236 weakly excites
- L22:2630 weakly suppresses
- L20:2681 weakly suppresses
- L2:1787 weakly suppresses
- L16:129 weakly suppresses
- L2:1622 weakly excites
- L1:577 weakly suppresses
- L18:198 weakly suppresses
- L24:533 weakly suppresses
- L23:2441 weakly excites
- L18:437 weakly excites
- L17:2992 weakly excites
- L25:215 weakly excites
- L13:1538 weakly suppresses
- L7:1146 weakly excites
Feeds later layers
- L27:796 weakly suppresses
- L27:2922 weakly suppresses
- L27:1511 weakly excites
- L27:1987 weakly excites
- L27:1845 weakly excites
- L27:672 weakly suppresses
- L27:2693 weakly excites
- L27:1742 weakly excites
- L27:639 weakly excites
- L27:2106 weakly suppresses
- L27:1515 weakly suppresses
- L27:1531 weakly suppresses
- L27:969 weakly suppresses
- L27:2746 weakly suppresses
- L27:1878 weakly suppresses
- L27:693 weakly excites
- L27:1559 weakly excites
- L27:1979 weakly excites
- L27:1650 weakly excites
- L27:2126 weakly excites
- L27:2048 weakly suppresses
- L27:2995 weakly excites
- L27:1329 weakly excites
- L27:1704 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 酐
- 府
- Connections
- ái
- chematic
- loh
- swick
- igung
- iết
- [thread
Suppresses
- ce
- AWN
- 傣
- 畢竟
- -du
- стр
- 圣诞
- �
- Extras
- anta