the 'cul' fragment in culprit and culminate
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the small piece 'cul' when it starts words like 'culprits' or 'culminated', and on similar word starts. When it was turned up, the written text did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
examination of mummified bodies has revealed that ancient Egyptians suffered from hardening of the arteries in surprising frequency, suggesting that blame for heart disease extends beyond the modern culprits of smoking, fast food and the remote control.⏎Among 22
-
decline from participating in unwanted situations, many people are saying social media can worsen peer pressure. Sites like Facebook, YouTube, Multiply, and Twitter are the prime culprits for such accusations. But is it true? How can peer pressure be
-
and Collaboration.⏎Soon after, I talked to my friend Karen Holmes about it who created an escape room for her Leadership class. Her scenario involves a zombie apocalypse and culminates in students finding the vaccine (she draws on her science background to have
-
French king supported the merchants, while the English sided with the artisans.⏎This tension culminated in 1337, over the status of the feudal territories of
-
. This two-fold classification of illnesses, based on whether they are caused by over nutrition3 or under nutrition, represents the germinal stages of theorisation that finally culminated in the conception of tridosha (three illness-causing factors). This
-
hood. This shift is part of a larger trend: American higher education has swung away from belief in educational access for all into a toxic obsession with meritocracy, culminating in the annual Squid Game frenzy that exploits
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if the one single fact that is very important to the world is one single fact that has been very subjectively subjectively subjected to human subjectively subjectively subjectively subjectively subjectively subjectively subjectively subjectively subjectively subjectively
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
rare disease that often impacts the lungs, affecting breathing. “The first time that I heard about Alpha 1 Antitrypsin Deficiency was on Wednesday, September 4
-
the burden of being a gay Asian student in a school they believe did not support him.⏎Miyairi created the new anti-bullying program specifically to address these issues.⏎"It's important for [students] to
-
) used to act, perform, fight and/or kill for the enjoyment of humans. The term encompasses many different forms of entertainment – from circuses to movies to bullfighting.⏎Share information about animals in entertainment.⏎- Animals have been used for
-
program provides a range of services in a safe and supportive environment to both youth and adults, and their families, who are dealing with anorexia nervosa, bulimia nervosa and avoidant/restrictive food intake disorder and binge eating
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:2613 suppresses
- L2:1008 weakly excites
- L9:3011 weakly suppresses
- L1:2218 weakly suppresses
- L21:1662 weakly suppresses comma introducing a quoted claim
- L8:737 weakly excites
- L14:609 weakly suppresses
- L20:151 weakly excites
- L22:2960 weakly suppresses
- L17:542 weakly excites
- L19:196 weakly excites
- L3:1101 weakly suppresses
- L21:1189 weakly excites
- L22:2138 weakly suppresses
- L3:1579 weakly excites
- L17:707 weakly suppresses
- L21:237 weakly suppresses
- L22:316 weakly suppresses
- L2:1321 weakly suppresses
- L5:9 weakly excites
- L23:1207 weakly excites
- L9:3055 weakly excites
- L9:329 weakly excites
- L1:951 weakly excites
Feeds later layers
- L26:598 suppresses spot just before a year or century
- L25:1452 suppresses
- L27:328 suppresses
- L25:2383 weakly suppresses
- L27:678 weakly excites
- L26:880 weakly suppresses
- L25:450 weakly excites
- L27:1522 weakly suppresses
- L27:902 weakly suppresses
- L27:180 weakly excites
- L25:333 weakly excites
- L25:752 weakly suppresses
- L27:572 weakly suppresses
- L25:621 weakly excites
- L25:850 weakly excites
- L26:2437 weakly suppresses
- L27:1246 weakly suppresses
- L27:1656 weakly excites
- L25:1895 weakly excites first digit of a year like 2020
- L25:1005 weakly suppresses
- L27:1215 weakly excites
- L25:1749 weakly excites
- L25:1733 weakly excites the 'per' piece in perished and per se
- L27:2167 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- over
- Cards
- Scalars
- head
- enames
- oping
- '').
- edef
- Up
- cards
Suppresses
- онт
- EDIUM
- chaud
- 巯
- fact
- arel
- ://'
- 薷
- _DENIED
- %"><