the 'n' that starts nectar
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the letter 'n' when it begins the word 'nectar', and it was also strong on a few other word starts. Turning it up made the model repeat 'stay' and similar words, which has little to do with flowers, so the link between the two is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
'the little hanger', and is thought to come from the way the sunbirds and sugarbirds appear to 'hang' from the flowers while feeding on the nectar.⏎Three formerly separate species have been included in this complex, namely
-
.⏎Crocus are a good choice to attract bees in the early spring. They're also pollinated by butterflies.⏎Asters are perennials that provide nectar and pollen, and do well when planted in late summer and fall.⏎Ger
-
Dictionary and Cyclopedia⏎- n. A sea-duck of the subfamily Fuligulinœ and genus Clangula; a garrot. The common goldeneye is C. glaucion
-
resource might have been premature. He thinks that boll weevils’ consumption of pollen from host plants other than cotton might actually occur as they’re feeding on nectar. He says that the nutritional properties of such pollens and their effect on
-
ily.⏎Lorikeets have a very simple digestive system. Proteins and fats are obtained from pollen and insects, and carbohydrates come from the sugars found in nectar. They spend a large amount of time foraging for food, which indicates
-
O-deyt ](verb): to make bare; strip; denude.⏎This fun word comes from the latin word “denudatus” which means “naked” or “ bare.”⏎With the days getting colder, the deciduous
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: swapping swap swapping swap swapping swapping swapping swap swapping swap swapping swap swapping swapping swapping swapping swapping swapping swapping swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping swap swapping
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and life of the people of the time. It was written in the second century A.D. by Illango Adikal, the prince of the royal lineage who renounced the royal heritage and took to the robes.⏎In Silapathikaram
-
estone mansions and residences forming an urban district that is a conservation area and one of the most outstanding Renaissance urban districts in France.⏎Bar-le-Duc invites you to explore its magnificent upper town<|endoftext|>Transdisciplinary Environmental Science
-
Pakistan, affecting both students and staff. From unwanted physical contact to verbal abuse, sexual harassment can take many forms and can have severe psychological and emotional consequences for those who experience it. Unfortunately, despite efforts to raise awareness and implement preventative measures, instances
-
. Prove AQ = AD.⏎At the time of writing the hour and minute hands of my clock are at⏎right angles. How long will it be before they
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:55 excites
- L22:2299 excites
- L17:391 weakly excites
- L21:567 weakly suppresses the word 'in' after a verb or noun
- L20:931 weakly excites the digit 6 inside years
- L23:491 weakly excites
- L18:127 weakly excites
- L18:924 weakly suppresses
- L19:617 weakly excites
- L19:277 weakly suppresses
- L16:673 weakly suppresses
- L9:2554 weakly suppresses
- L20:2883 weakly suppresses
- L19:1286 weakly excites
- L0:1145 weakly excites
- L19:770 weakly excites
- L16:74 weakly suppresses
- L11:981 weakly suppresses
- L8:369 weakly suppresses 'of' after 'learned' or 'because'
- L22:3065 weakly excites
- L2:2028 weakly excites
- L24:319 weakly suppresses
- L0:771 weakly suppresses
- L25:2670 weakly excites
Feeds later layers
- L27:946 weakly excites
- L27:3056 weakly suppresses
- L27:2140 weakly excites
- L27:435 weakly suppresses
- L27:1199 weakly suppresses
- L27:2151 weakly excites
- L27:1853 weakly suppresses
- L27:1783 weakly excites
- L27:369 weakly suppresses
- L27:1717 weakly excites 'st' starting a word fragment
- L27:1012 weakly suppresses
- L27:1828 weakly excites
- L27:1182 weakly suppresses
- L27:1200 weakly suppresses
- L27:992 weakly excites
- L27:2276 weakly excites
- L27:1655 weakly suppresses
- L27:2594 weakly excites
- L27:3028 weakly excites
- L27:2716 weakly suppresses
- L27:2354 weakly excites
- L27:2678 weakly suppresses
- L27:2447 weakly suppresses
- L27:2114 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- stay
- stays
- staying
- remain
- work
- stay
- remains
- oth
- stayed
- remain
Suppresses
- .swap
- swap
- swapping
- ierce
- swap
- ature
- ASSERT
- 自有
- Zack
- liche