'New' in place names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'New' when it starts a place name, such as New York, New Mexico or New Madrid. When turned up, the model kept producing the word 'their' over and over, which fits what the neuron seems to push toward.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Brigade on February 19, 1862. Lt. Col. Tinkham and the 26th Illinois Volunteers engaged Confederate troops at New Madrid, Missouri and took part in the siege of Corinth, Mississippi. On May
-
J. Hardee, and General James Longstreet led the way in the South’s fight for its independence. Critical battles at Dalton, Resaca, Dallas, New Hope Church, and Kennesaw Mountain were fought only a short distance from our
-
that the terrain affected the formation of the glacier, intensifying the cooling of the ice.⏎Weather cycles also showed seasonal frosts that match data collected by NASA’s New Horizons mission and observations of polar flares seen since 1985
-
they couldn’t,” he said.⏎Trujillo enlisted in the U.S. Army in <|endoftext|>On June 12, 1909, New York City began an eight-day celebration of the connection of the East Side of Manhattan
-
Earth from a new perspective on 24th October, 1946, when a V-2 rocket lifted the first ever space-bound camera above New Mexico on a short sub-orbital flight. From an altitude of 6
-
ens and J.P. "The Big Bopper" Richardson died in a small plane crash near Clear Lake, Iowa. An American Airlines Lockheed Electra crashed into New York's East River, killing 65 of the 73
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: It would be a problem for a few thousand people to be able to look up where and when to get something as easily as Google, but for the few thousand thousandth thousandthth thousandth thousandthth thousandth thousandthth thousand
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
foods, such as peppers and hot sauce, can trigger inflammation and cause redness and flushing in those with sensitive skin. Capsaicin, the compound that gives peppers their heat, can irritate the face and even cause burning and itching. For
-
s and roots, e.g. kelp and seaweeds.⏎The cultivation of those plants holds great potential for future use. Microalgae are known for their fast forming of biomass, using only the energy of sunlight, carbon dioxide and
-
leopard grows quickly: Cubs are small and helpless when they are born, and do not open their eyes until they are about 7 days old.⏎At 2 months old
-
-Alamo.⏎As the scientist indicates, tactics against their hunters are "crucial" so that birds can adapt to their new environment: "Birds should modify their behavior to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:481 strongly excites
- L24:183 strongly suppresses
- L25:692 strongly excites
- L23:1456 strongly suppresses
- L21:1091 strongly suppresses
- L20:1110 strongly excites
- L21:275 strongly excites
- L22:448 strongly suppresses
- L20:1968 strongly excites
- L25:2286 strongly excites
- L21:1552 strongly suppresses
- L20:1842 strongly suppresses
- L19:1422 strongly excites
- L24:980 suppresses
- L20:2075 suppresses
- L19:1629 excites
- L24:1437 suppresses
- L23:447 excites
- L19:2849 suppresses
- L6:410 excites
- L24:477 excites
- L21:1040 suppresses
- L7:146 excites
- L22:614 suppresses
Feeds later layers
- L27:1047 strongly excites
- L27:1646 excites
- L27:813 excites
- L27:578 excites
- L27:1102 weakly excites
- L27:953 weakly excites
- L27:619 weakly excites
- L27:1677 weakly excites
- L27:1771 weakly suppresses
- L27:1950 weakly excites
- L27:1906 weakly suppresses
- L27:292 weakly excites
- L27:990 weakly suppresses
- L27:2345 weakly excites
- L27:2505 weakly suppresses
- L27:1381 weakly excites
- L27:1181 weakly excites
- L27:1313 weakly excites
- L27:1636 weakly excites
- L27:2439 weakly excites slash inside web addresses
- L27:2988 weakly suppresses capital M starting a word
- L27:413 weakly excites
- L27:1328 weakly excites
- L27:853 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 他们的
- their
- their
- Their
- themselves
- Their
- 她们
- 他们在
- 他们
- 因为他们
Suppresses
- hood
- alyze
- gricult
- ))];⏎
- LEMENT
- umerator
- ial
- atomy
- '])[
- ']];⏎