comma that ends a clause before a result
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that finishes a full statement and sets up a consequence or extra detail, such as 'associated with a lower risk of death from any cause, finds...'. Turning it up made the model produce filler phrases like 'for example' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
particularly plant protein, linked to lower risk of death⏎Diets high in protein, particularly plant protein, are associated with a lower risk of death from any cause, finds an analysis of the latest evidence published by The BMJ today. ...continue
-
a kind of antioxidant are believed to play a significant role in whittling your middle.⏎Lab rats who were fed a blueberry-rich mixture had less abdominal fat, lower triglycerides, lower cholesterol, and improved fasting glucose and insulin sensitivity which
-
but once you see the incredible benefits you could never look back. It cooks your food and keeps it piping hot. The more you incorporate it into your daily life, the more you will find you use it.⏎A degree of experimentation is necessary to
-
ews⏎The use of active voice is important while writing online content. It improves the readability of your copy and reduces the wordiness. The lines seem more direct, so this is a good way to avoid fluff.⏎Active and Passive Voice –
-
reasons. … First and foremost, plastic is much lighter and more aerodynamic than metal, which improves the car’s fuel efficiency. Plastic is also easier to shape, which is
-
body’s primary energy source. Your body cannot absorb the disaccharide, or two-sugar molecule, as is, so it must first sever the chemical
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: for a while, I have been in the group of both of me, for a short period of time, for the rest of the time, I am, in the end, the sum of both of me, for a short period of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
($) before the answer.⏎Subtracting money is easy, too, so long as it is once more remembered that money has to be written and subtracted the way that decimals are written and subtracted. Dollars go to the left of the decimal
-
15 S.W. Second St. in Corvallis. It is free and open to the public. In November, Science Pub will resume at its usual location at the Old World Deli.⏎
-
sponsored by the Jewish Student Union and supported by Campus Ambassadors, Students Against Slavery and Willamette University's Religious Studies Department.⏎For more information contact Jessica Sternbach at firstname.lastname@example.org.<|endoftext|>St. Peter's Cathedral is one of
-
son knew this day was coming. Of the hundreds of thousands of people left stranded last week on foreign soil—hostages to an ash-spewing hell vent whose name only Icelanders could pronounce—the B.C. volcanologist might have been best equipped
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:556 suppresses
- L10:1278 excites
- L9:74 suppresses
- L13:44 excites inside web addresses and citations
- L7:92 suppresses
- L11:223 suppresses
- L9:207 excites
- L15:184 suppresses
- L4:42 excites
- L10:873 suppresses
- L8:328 weakly suppresses
- L4:92 weakly excites
- L1:2790 weakly suppresses
- L10:155 weakly suppresses
- L2:166 weakly excites
- L10:370 weakly excites
- L12:35 weakly suppresses
- L4:236 weakly suppresses
- L10:565 weakly suppresses
- L0:509 weakly suppresses
- L9:2581 weakly suppresses
- L16:1309 weakly excites
- L14:2375 weakly excites
- L10:0 weakly suppresses
Feeds later layers
- L21:2512 excites
- L19:2999 excites
- L19:1265 excites
- L19:1409 weakly excites
- L25:1337 weakly suppresses
- L24:2331 weakly suppresses
- L20:2132 weakly excites "the" starting an object noun phrase
- L20:2038 weakly excites
- L22:2055 weakly excites
- L23:1540 weakly excites
- L26:1113 weakly suppresses
- L25:796 weakly suppresses
- L19:2302 weakly suppresses
- L19:298 weakly excites
- L19:1873 weakly excites
- L19:693 weakly excites
- L23:1086 weakly suppresses
- L22:281 weakly suppresses
- L23:2859 weakly suppresses
- L27:2691 weakly suppresses
- L19:3065 weakly suppresses 'for' after a span of time
- L22:1497 weakly suppresses
- L21:2749 weakly suppresses
- L26:1528 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- “This
- ammers
- liệu
- veys
- Aws
- ulations
- “A
- qualifications
- 等内容
- клад
Suppresses
- า
- Stateless
- 叶
- EMPL
- elen
- :]
- lessly
- out
- 州
- 燮