"and" inside organisation names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "and" when it sits in the middle of a formal name, like an institute, a division or a centre ("Wage and Hour Division", "Center for Economic and Community Development"). Turning it up made the model's text drift toward unrelated, rambling topics, so the steering output doesn't show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
even try new foods! Learn more about the role of food, health and sustainable lifestyle from the UCD Institute for Food and Health lecture series which seeks to harness the expertise of researchers to future-proof global food
-
your doctor to find out which tests are right for you.⏎Other Works Consulted⏎- Expert Panel on Integrated Guidelines for Cardiovascular Health and Risk Reduction in Children and Adolescents (2011). Expert panel on integrated guidelines for cardiovascular health
-
from one to the other. One qualification: OED refers only to a Roman vaulter but the Wordsworth Dictionary of Phrase and Fable elaborates. Not the most authoritative of sources, hence the qualification,
-
universal and regional human rights instruments such as the International Covenant on Civil and Political Rights. The African Charter, and the International Convention on Social Economical and Cultural Rights. In their preambles,the treaties ‘recall that human rights are
-
must not be interpreted as definitive evidence that a fetus does or does not have an aneuploidy. Recent recommendations from the American College of Obstetricians and Gynecologists (ACOG) are quite clear on that issue.⏎In those
-
an earthquake shook the ground, as reported in the Jakarta Globe. The Jakarta Post quoted Thomas Djamaluddin, head of the Lapan Center for Climate and Atmosphere Science Implementation as saying that the explosion was due
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I have a problem" (I have a problem) (I have a problem) (I) (I) (I) (I) (I) (I) (I) (I) (I) (I)
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
-1842, and a letter from John Ridge to Georgia governor Wilson Lumpkin dated September 22, 1833 notifies the governor of murders committed against pro-removal Cherokees by anti-removal Ch
-
ner is an articulate and convincing salesman for his new method, and the national laboratory where he works has an excellent reputation; he is able to convince the management board of Toxic Waste Disposal Administration to use the new method. Federal funding is provided to
-
Trials network is conducting the study with funding from the National Institute of Allergy and Infectious Diseases and the Eunice Kennedy Shriver National Institute of Child Health and Human Development, both part of the National Institutes of Health. Led by protocol chair
-
1430-1480), secretary to Cardinal Bessarion and archbishop of Siponto, donated to Sassoferrato, the city of his birth, a collection of reliquaries, including the Mosaic
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:982 strongly suppresses
- L8:419 strongly suppresses
- L7:223 strongly excites
- L3:47 strongly suppresses
- L7:685 excites
- L6:32 excites
- L7:489 suppresses
- L7:712 excites
- L4:152 excites
- L3:74 excites
- L8:926 excites
- L6:2415 suppresses
- L6:199 excites
- L7:2503 suppresses
- L6:181 excites periods in abbreviations and the 's in names
- L4:48 suppresses
- L7:401 suppresses
- L7:616 excites
- L8:542 excites
- L6:141 suppresses
- L8:1613 excites
- L7:173 excites
- L2:26 suppresses
- L8:1038 excites
Feeds later layers
- L12:1823 strongly suppresses
- L10:452 strongly suppresses
- L12:1112 strongly suppresses
- L14:493 strongly suppresses
- L13:1108 strongly suppresses
- L12:792 suppresses
- L10:703 excites
- L15:1846 suppresses
- L18:933 suppresses
- L14:347 suppresses
- L13:423 suppresses
- L17:1567 suppresses
- L16:928 suppresses
- L13:473 suppresses
- L12:707 suppresses
- L10:235 suppresses
- L12:940 excites
- L16:611 suppresses
- L11:1753 suppresses
- L15:1625 suppresses
- L18:617 suppresses
- L10:125 excites
- L12:3063 suppresses
- L10:1317 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 다
- bye
- ewise
- aul
- protected
- _coll
- malı
- ongs
- confirmed
- ustr
Suppresses
- =⏎⏎
- 性和
- ({⏎⏎
- etch
- "⏎⏎
- .";⏎⏎
- 期内
- smarty
- boBox
- .*⏎⏎