comma after an introductory generalization
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that closes a short lead-in phrase, like 'As with most diet choices,' or 'Like all mosquitoes,' right before the main point of the sentence. When it was turned up, the model's text got repetitive and drifted off topic, so the steering output doesn't reveal much more.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the rate at which your brain ages. Certain habits may slow down the brain aging process, while others may speed it up.⏎As with most diet and lifestyle choices, moderation is key; you shouldn't deprive yourself all the time, but when
-
Snakes?⏎What state has the least amount of snakes? That makes Alaska one of two states to be snake-free, the other being Hawaii. As an island, Hawaii is more representative of why most countries without snakes have gotten so lucky: They
-
depending on the region and the environment. However, only female mosquitoes can transmit malaria.⏎Like all mosquitoes, the Anopheles species goes through four stages in its life cycle:⏎The first
-
myself? Okay, obviously, the paper is about how black flies might be of some use to us. So let’s get to it.⏎Like most biting insects, black flies (
-
ilitation. In essence, a protective sheath called myelin is attacked by the body’s own immune system, triggering an inflammatory response.⏎As with many autoimmune diseases, MS is a bit of a mystery. The cause is unknown though more than
-
facilitate habits and, for some, sustained compulsivity and addiction. Like other complex illnesses and disorders, addiction is multifactorial, resulting from a combination of genetic, social, psychological
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first place, the first place, the first place, the first place... the first place... the first place... the first place... the first place, the first place... the first place... the first place... the first place,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ion vs Empathy: What Is the Difference?⏎What Is Empathy?⏎Empathy is the ability to put yourself in someone else’s shoes. In other words, it’s the ability to feel or understand another person. Experts suggest it’s innate
-
is already changing the climate policy discussion both within countries and among them. By showing concretely how 2°C can be achieved and what the enabling conditions are, it is altering the focus from incremental change to transformation, and shining a bright new
-
politics changed over time—and how understanding the past sheds light on the current campaign. From the arrival of “dirty politics” to the impact of the “digital revolution,” the course looks at the historical background to some of the key phenomena that shaped the
-
home aquarium! These hardy African catfish are popular freshwater aquarium fish due to their beautiful and unique patterning. They’re also relatively easy to care for, making them an ideal choice if you’re just starting out in the hobby of keeping fish
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1285 suppresses
- L15:772 excites
- L12:2416 excites
- L14:736 excites
- L14:1993 excites
- L15:256 excites
- L15:2111 excites
- L12:2347 suppresses
- L13:1014 suppresses
- L13:2636 suppresses
- L13:2322 suppresses
- L14:2056 suppresses
- L15:975 suppresses
- L13:407 suppresses
- L11:459 excites
- L13:251 suppresses
- L14:2416 suppresses
- L15:391 suppresses
- L13:1232 excites
- L9:1444 excites
- L12:1684 excites comma after a transition word
- L14:2381 weakly excites
- L15:2479 weakly suppresses
- L15:1047 weakly suppresses
Feeds later layers
- L18:1860 suppresses
- L17:2809 suppresses
- L17:1536 suppresses
- L17:654 suppresses
- L18:2266 suppresses
- L18:2903 suppresses
- L18:494 suppresses
- L21:492 suppresses
- L18:2684 excites
- L18:2721 suppresses
- L26:405 suppresses
- L18:1220 suppresses
- L19:222 excites
- L18:2482 suppresses
- L18:183 excites
- L19:2766 suppresses
- L18:1275 suppresses
- L22:1854 suppresses
- L27:528 suppresses
- L24:803 suppresses
- L21:2334 suppresses
- L20:42 excites
- L18:2713 suppresses
- L20:1487 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- URN
- rch
- riv
- 饱
- истории
- nbr
- xl
- ISTRY
- ränk
- ))/(
Suppresses
- 这种方法
- 此
- this
- 这家公司
- this
- 这里
- 这款游戏
- 这里是
- 这次
- 這裡