'of' inside fixed titles and names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word of when it sits inside a fixed title or name, like Rights of the Child, Ring of Fire or Status of Refugees. Turning it up made the model repeat cheerful phrases such as Eat Healthy or Sleep Better, which does not clearly match.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
how to help take charge of their own lives - to protect themselves and others from the virus in situations of risk."⏎The Committee monitors the UN Convention on the Rights of the Child, signed by all
-
caused nearly $10 billion in damage and more casualties than any other tsunami in history, according to the United Nations.⏎Indonesia is on the so-called Ring of Fire, an arc of fault lines circling the Pacific Basin that is prone to
-
artifacts. But after the unification of Italy in 1861 the collections were broken up and abandoned, until the foundation of the Institute of the History of Science in 1927. The aim of the institute was to collect
-
limited bargaining power, disadvantages in land rights, unpaid<|endoftext|>SYMBOLIC COMMUNICATION IN THE TUTURANGIANA ANDALA RITUAL: TRANSLATING THE CONVERSATIONS OF THE BUTONESE WITH THE SEA⏎Keywords:Tut
-
ets, how they formed and how they evolve, by surveying a diverse sample of about<|endoftext|>CONTRIBUTION OF MUSLIMS SCIENTIST IN THE FIELD OF MEDICINE AND PHARMACY⏎In the Modern Muslim world is
-
what they feared would be a right-wing coup, whether in fact or⏎in name. Within a few days, the CNT and the Socialist General Confederation of Workers (UGT), which since December 1933 had been discussing
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: It is not just pan-regiobian extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extradiagonal extr
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Portuguese troops killed some 1,000 striking plantation workers.⏎In 1959, rock-and-roll stars Buddy Holly, Ritchie Valens and J.P. "The Big Bopper" Richardson died in a small plane crash
-
key. "Weather stripping and caulking in existing homes can reduce your energy bill 10 to 25 percent," says David Johnston, president of What's Working, a green building consultancy. "Energy prices will escalate over the next few
-
another smash hit would break through in American entertainment. Film director Spike Lee’s “Do The Right Thing” was set in the same multicultural Brooklyn as “The Cosby Show,” but now it was a simmering cauldron of racial
-
a man,” Peterson said in a statement.⏎Among those coming to Peterson’s defense was NBA Hall of Famer Charles Barkley. On the CBS pregame show The NFL Today, Barkley recalled childhood beatings. “I’ve had many wel
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:484 strongly excites
- L20:473 strongly suppresses
- L19:1941 strongly excites
- L19:1485 strongly suppresses
- L19:474 strongly excites
- L25:198 strongly suppresses
- L20:351 strongly excites
- L19:2730 strongly suppresses
- L23:278 strongly excites
- L24:192 strongly suppresses
- L21:335 strongly suppresses
- L21:846 strongly excites
- L20:296 strongly suppresses
- L21:370 strongly excites
- L19:2829 strongly excites
- L19:1240 strongly suppresses
- L19:96 excites
- L19:68 excites full stops closing a claim
- L19:1455 suppresses
- L23:242 excites
- L22:341 suppresses
- L20:308 excites
- L18:2824 suppresses
- L19:3015 excites
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Crossing
- Ready
- Eat
- Souls
- Healthy
- Everyday
- Alive
- Tough
- Better
- Wear
Suppresses
- 此基础上
- PLIC
- diagonal
- bian
- .it
- 다고
- нием
- ordes
- ámara
- rance