'fl' and 're' word starts
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the start of some words, most clearly 'fl' in flutters, flaking and flit. It goes the other way on 're' at the start of words like re-education or self-repair. Turning it up made the model keep saying 'refresh', which matches what the neuron seems to push toward.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
feather at the same time… which one hits the ground first?⏎- Obviously, common sense will tell you that the bar will hit first, while the feather slowly flutters to the ground.⏎- In Aristotle’s view, this was because the bar
-
to the plant, the faster the rate of photosynthesis - if other factors are favourable.⏎Plant respiration captures CO2.⏎Unlike photosynhesis, plant respiration captures atmospheric oxygen and releases carbon dioxide.⏎The rate of respiration decreases with
-
that causes skin cells to grow at a faster rate than normal, resulting in thick white, silver or red patches of skin. Under normal circumstances skin cells grow and flake off after every four weeks. However, in the case of psoriasis new
-
1 cup lard) then heating and stirring over moderate heat⏎until the desired color is achieved (overheating will cause it to lose its⏎red color<|endoftext|>How would you classify someone who is morbidly
-
out if it:⏎- changes shape or looks uneven.⏎- changes colour, gets darker or has more than 2 colours.⏎- starts itching, crusting, flaking or bleeding.⏎- gets larger or more raised from the skin.⏎What do
-
in the sky - It's a bird! It's a plane! It's a ... hummingbird!⏎Those fragile-looking little flecks of light and noise that flit to and fro are not nearly as delicate as they might seem. Looking like
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: when you think of social organizations, you think of family, family organizations, family organizations refreddo, family refreddo refreddo, family refreddo refreddo refreddo refreddo refreddo refreddo
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
be noted that during the process of clearing the body of toxins, the liver is damaged by exposure to harmful substances. The liver therefore possesses the amazing ability to self-repair and regenerate of damaged tissues.⏎So as one can plainly see, proper liver
-
few days following.⏎80-90% of people with a concussion make a complete recovery within 1-4 weeks. The recovery occurs as the brain re-calibrates after using an excessive amount of energy following the initial impact. Therefore
-
when this Electrical nerve stimulation treatment is given regularly.⏎Benefits of Ultrasound Therapy⏎- Re-education of Muscle contractions⏎- Increase in blood flow⏎- Maintenance of
-
war would last less than four months, but saw the downfall of the Spanish Empire and the rise of America as a major world power with several new possessions.⏎Britain Repeals the Stamp Act⏎On March 18, 176
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:239 weakly excites
- L22:2630 weakly suppresses
- L18:103 weakly excites
- L5:2200 weakly excites
- L10:2918 weakly excites
- L19:244 weakly excites
- L2:964 weakly excites
- L0:2886 weakly excites
- L21:346 weakly excites
- L16:19 weakly excites
- L4:1981 weakly suppresses
- L3:929 weakly suppresses
- L16:145 weakly suppresses
- L10:5 weakly suppresses
- L6:1742 weakly excites
- L3:667 weakly excites
- L20:1983 weakly excites
- L6:2778 weakly excites
- L21:1663 weakly excites
- L4:2532 weakly suppresses surname pieces split across tokens
- L9:2216 weakly suppresses
- L3:232 weakly suppresses 'on' after a noun like 'impact on'
- L5:50 weakly excites
- L21:2570 weakly suppresses
Feeds later layers
- L27:1600 weakly excites
- L27:2902 weakly suppresses
- L27:2525 weakly excites
- L27:1072 weakly suppresses
- L27:3004 weakly excites
- L27:1068 weakly excites
- L27:1700 weakly suppresses
- L27:2775 weakly suppresses
- L27:1424 weakly excites
- L27:855 weakly excites
- L27:2332 weakly excites
- L27:1325 weakly excites
- L27:403 weakly excites
- L27:2728 weakly excites
- L27:476 weakly suppresses
- L27:2392 weakly excites
- L27:2173 weakly suppresses
- L27:2649 weakly excites
- L27:893 weakly suppresses
- L27:1641 weakly excites
- L27:2204 weakly suppresses
- L27:1554 weakly excites
- L27:2562 weakly suppresses
- L27:2897 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- refresh
- refresh
- baths
- Refresh
- Refresh
- .Refresh
- marine
- arks
- _refresh
- refreshed
Suppresses
- redd
- chy
- ez
- 尺
- GOR
- emin
- Zero
- zero
- 配偶
- winding