"a" or "the" opening an object noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small words "the" or "a" right after a verb or preposition, where a noun is about to follow, such as "showed the" or "write the". When it was turned up, the text drifted into repeated "a" and "a certain" phrasing, with no clear topic.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
/2 fasting, which involves eating regularly for 5 days, with 2 non-consecutive fast days.⏎- Time-restricted fasting, which limits eating within a certain window of time each day. This method appeals to many people because you can
-
and a new study indicating that drinking diet soft drinks may increase risk for stroke only makes us more worried about the mysterious effects of those calorie-free cans. Researchers tracked the habits and health of about 2,500 adults in Manhattan over a
-
considering the carbon-farming legislation. Introduced by senators Mike Braun (R-Indiana) and Debbie Stabenow (D-Michigan), the bill sets up the US Department of Agriculture to certify independent consultants for farms that want to participate in carbon
-
with your counselor and discuss⏎- With your parent's permission, locate at least five Web sites that are helpful for⏎your Scouting or other activities. Write the Internet addresses of these sites in⏎your log. Talk with your counselor or a
-
figured out who it was — Italian Prime Minister Silvio Berlusconi.⏎Todorov's next example illustrated how facial recognition can have serious consequences. He showed the students a photo of Darrell Edwards, a man who is currently fighting a
-
were laser cut (bottom right).⏎Task: For this final project exercise, students were given the constraint of working with a common and uncommon design material. The team highlighted in this
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: a new a A) a A) a A) a A) a A) a A) a A) a A) a A) a A) a A) a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of people with particular medical conditions to determine DNA variants linked to those diseases, said University of Washington genome scientist Dr. John Stamatoyannopoulos, lead author of a study examining the connection between gene regulation and disease published Wednesday in the journal Science
-
718<|endoftext|>Women who have kids later on in life may live longer, according to the findings of a recent study.⏎Following the birth of a woman’s last child, certain measurements
-
a plant-based diet can help you lose weight without counting calories and without ramping up your exercise routine,â saysNeal Barnard, M.D., lead author of the study, president of the Physicians Committee, and an adjunct associate professor of medicine
-
defines work order, i.e., the sequencing of tasks): This is work management.<|endoftext|>Small businesses are starting smaller and staying smaller. That’s the conclusion of a study released by entrepreneurship advocate Kauffman Foundation.⏎“Starting
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:2960 strongly excites
- L19:1050 suppresses
- L14:2473 excites
- L17:763 suppresses
- L17:2320 excites
- L17:2728 excites
- L15:2008 excites
- L18:1740 suppresses
- L15:826 excites
- L15:29 suppresses
- L17:1470 excites
- L18:2323 suppresses
- L19:2438 suppresses
- L15:1715 excites
- L19:1610 suppresses
- L19:2756 suppresses
- L19:1475 excites
- L16:691 excites
- L19:1352 excites
- L18:1991 suppresses
- L18:735 suppresses
- L15:2603 weakly excites
- L19:2227 weakly suppresses
- L17:1983 weakly excites
Feeds later layers
- L22:103 strongly excites
- L25:45 strongly excites
- L27:797 strongly suppresses
- L27:663 strongly suppresses
- L24:2538 strongly suppresses
- L25:1586 strongly suppresses
- L24:823 strongly suppresses
- L21:1457 strongly excites
- L26:484 strongly suppresses
- L26:213 excites
- L27:709 suppresses
- L25:871 suppresses
- L27:231 excites
- L27:173 excites
- L25:1132 excites
- L27:854 suppresses
- L25:549 suppresses
- L26:411 excites
- L21:1265 suppresses
- L27:1044 suppresses
- L27:2396 suppresses
- L25:837 suppresses
- L21:1725 suppresses
- L26:677 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ittel
- 娃
- ��
- ясн
- ernes
- parable
- الوا
- رام
- orges
- 率达到
Suppresses
- a
- an
- 某种
- another
- 一个新的
- something
- 一个
- 一种
- something
- 某个