'the' after 'disease of' or 'infection of'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'the' when it follows phrases like 'disease of' or 'inflammation of', where a body part or organ is about to be named. Turning it up made the model's writing drift without a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the nectaries. Watch too for bees landing on discolored leaves and licking them; this behavior transmits Monilinia, a fungous disease of the fruits.⏎Because so many members of the blueberry clan live
-
buhr DW, Scher AI, Munger KL and Ascherio A⏎Multiple sclerosis (MS) is a chronic inflammatory demyelinating disease of the central nervous system of unknown etiology
-
their air passages are small, an RSV infection can clog up the air passages much more easily. RSV bronchiolitis (inflammation of the small air passages) and RSV pneumonia are very common during the season (usually
-
you're dehydrated or if you're on a low-sodium (low-salt) diet⏎- you have Addison's disease, a rare disorder of the adrenal glands⏎- you have, or someone in your family has, a rare
-
was the Annual Reminder march of July 4, 1965, one of the first LGBTQ protests in the nation’s history (four years ahead of the historic Stonewall riots). Gay rights pioneers Jack Nichols and Barbara Gittings were
-
reported wrecked off the sandbar in December of 1782.<|endoftext|>Primary herpetic gingivostomatitis is a highly contagious infection of the oral cavity which is caused by the herpes simplex virus. It is prevalent
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the role of a teacher? The role of a teacher? The role of a teacher? And the role of a teacher? Yes, the role of a teacher. The role of a teacher. Now, I have thought about it. I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
That can be as simple as a long alkyl chain, or a short stretch of ethylene glycol ethers, up to as complex a linker as you have the patience to search for.⏎It seems like a rather simple idea that you could get
-
of the colonists.⏎a government is supposed to work for its people and if the government fails to properly work for its people then the people are allowed to ____ the government.<|endoftext|>Actually, hydrogen in its gas form is too light⏎to be
-
Alberta’s international merchandise exports last year. If we exclude oil and gas extraction and petroleum refinery exports, its share rises to 36%.⏎- Alberta exports the third largest amount of agricultural
-
agiarism software can be used to help determine how original - or unoriginal - a student's written work may be. A student who makes documentation errors runs the risk of being accused of not just making a mistake,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:772 suppresses "it" as a subject pronoun
- L7:396 excites
- L8:577 excites
- L4:1088 suppresses
- L4:52 weakly excites
- L6:136 weakly suppresses
- L8:715 weakly suppresses
- L6:142 weakly excites
- L5:227 weakly suppresses
- L6:606 weakly suppresses
- L6:1114 weakly excites
- L6:1752 weakly excites
- L7:1474 weakly suppresses
- L6:2635 weakly suppresses
- L3:1869 weakly suppresses
- L4:229 weakly excites
- L2:464 weakly suppresses
- L5:2086 weakly excites
- L6:1968 weakly suppresses
- L2:1126 weakly excites
- L8:2015 weakly suppresses
- L7:138 weakly excites 'to' after verbs like prove or time
- L3:735 weakly suppresses
- L8:1027 weakly suppresses
Feeds later layers
- L10:578 excites
- L10:1832 suppresses
- L13:1406 weakly suppresses
- L13:1515 weakly excites "your" before doctor or health provider
- L16:2389 weakly excites
- L10:2455 weakly excites
- L11:604 weakly suppresses
- L20:1926 weakly excites
- L27:690 weakly suppresses
- L19:2788 weakly excites
- L10:29 weakly excites
- L12:1492 weakly excites
- L22:1546 weakly suppresses 'to' after surprised or glad
- L12:2810 weakly suppresses
- L11:558 weakly excites
- L18:192 weakly suppresses
- L10:334 weakly suppresses
- L22:571 weakly suppresses
- L12:1529 weakly suppresses
- L22:1143 weakly excites
- L25:1472 weakly excites
- L18:305 weakly excites
- L12:1404 weakly suppresses
- L12:3051 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 是我的
- 师兄
- 환
- ことで
- 并与
- 颊
- 可以从
- 是我
- 好朋友
- lates
Suppresses
- _|
- mö
- SQLException
- _⏎⏎
- SCP
- ()?
- realize
- _();⏎
- [_
- ıklı