'well' in well-dressed, well-known, well-off
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'well' when it appears in phrases like 'well-dressed', 'well known', 'well off' or 'well-to-do'. Turning it up made the model write comparisons and repeated phrases, which does not clearly match this word.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
activity. During the 1840's, this tiny village, once a mile long, was larger than Charlotte and hosted a collection of the wealthy and well-dressed. After 1849, Gold Hill lost a great deal
-
и) of the Don, Kuban, Terek and Ural rivers and the Ukrainian Cossacks (козаки), respectively. Somewhat less well known are the Polish Cossacks (Kozacy) and the Tatar
-
Savannah, Georgia after Jacob encountered financial difficulties. It is not known how much formal schooling Phoebe had, but she was clearly well read and worldly. In 1856, she married a non-J
-
.⏎This is because climate change appears to be altering the weather conditions wide-ranging birds encounter before, during + after their migration. With some species no longer being as well adapted to, or synchronised with, the conditions they encounter during their travels as
-
the foremost combat weapons.⏎Acknowledging the significance of the availability of good shields for successful warfare, Carolingian rulers took special care to ensure that their soldiers were well-supplied with ample shields.⏎Shields were used by both the cavalrymen and
-
composition.⏎The composer was born in 1810 in the village of Zelazowa Wola, not far from Warsaw. His family was not well off, but they had a strong appreciation for music. Chopin’s mother could
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a new family member, a woman with a name of the same name as my mother. I have a male child with a name of the same as my father. Her name is also the same as the female name of my mother
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1 USA. They are now with the Department of Construction, Chaoyang University of Technology, Taichung 41349, Taiwan (corresponding author's e-mail: firstname.lastname@example.org, email@example.com).⏎Ch
-
the trends of infectious diseases and the mechanisms of Adaptive diseases.⏎Department of Pediatrics, Soroka University Medical Center, Beer-Sheva, Israel⏎- *Corresponding Author:⏎- Yeongha Wook⏎Department of Pediatrics,⏎Sor
-
Identify leaks⏎- Determine if any water fixtures or appliances are not working properly⏎- Identify irrigation system problems such as damaged or misdirected spray heads, non-functioning rain sensors or soil moisture sensors⏎- Determine how water is used at the
-
Like a whole cadre of other prosthetic researchers and makers, they are interested in breaking down the process, figuring out how to turn 3-D printing into something self-sustaining
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1976 strongly excites
- L20:1529 suppresses
- L21:916 suppresses
- L21:347 suppresses
- L20:2673 suppresses
- L19:1159 suppresses
- L21:1370 suppresses
- L19:2781 suppresses
- L18:1180 excites
- L22:550 suppresses
- L20:2831 excites
- L19:1739 suppresses
- L21:1296 excites
- L19:1225 excites
- L18:962 excites
- L19:2208 excites
- L16:1819 excites
- L19:561 excites
- L20:853 suppresses
- L21:1550 suppresses
- L21:1999 excites 'well' in compound adjectives
- L22:1654 suppresses
- L21:1872 suppresses
- L14:2539 weakly suppresses
Feeds later layers
- L24:422 strongly excites
- L25:349 strongly excites
- L27:217 excites
- L26:138 excites
- L26:144 excites
- L25:1852 excites
- L27:869 excites
- L27:716 excites
- L27:1596 excites
- L27:1295 excites
- L27:1451 excites
- L27:1281 excites
- L26:395 excites
- L26:1188 excites
- L27:1514 excites
- L24:258 suppresses
- L26:632 excites
- L25:644 excites
- L27:1832 excites
- L26:1940 excites
- L26:922 excites
- L26:891 excites
- L24:239 weakly excites
- L27:1110 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- anked
- icked
- treated
- tested
- eded
- acted
- tried
- analyzed
- played
- initiated
Suppresses
- ẫn
- 人的
- になる
- :relative
- inging
- attaching
- ative
- 方面的
- ersh
- ewing