'New' in place names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'New' in place names like New York, New Orleans and New England, and on a few other place-name words such as 'Saint'. When it was turned up, the model drifted toward place-related words like 'metropolitan area', while turning it down pushed it into repeated phrases.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
depending on how much and how fast the state plans to cut pollution in coming years, a recent National Resources Defense Council analysis shows.⏎Maine and the five other New England states are among the nine states participating in the Regional Greenhouse Gas Initiative,
-
. The bridge across Lake Pontchartrain into New Orleans is barely visible as a slightly brighter line against the lake's green and brown
-
1, 1825, and construction completed on July 10, 1831. Since 1776 this portion of New York harbor has been a strategic base for coastal defense. Fort Lewis, once located
-
burg and Iredell, and several mines, some still in operation, in Stanly county in the New London/Richfield area. But Gold Hill, just a few miles from Stan
-
Ribaud, built Charlefort at Port Royal in 1562, and Fort Caroline under Laudonniere, at the River May (now St. John’s, Florida), in 1564. […]⏎Jac
-
. His army passed through on York Road several times and Washington stopped over at the Hartsville Inn on several occasions, traveling between Philadelphia and Coryell's Ferry (New Hope). The action of the Battle of Crooked Billet took place just south
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I want to get older in my mind, and I want to see light in her eyes in her light. In her light her light will be light in her eyes. In her light, her light will be her light. In her light
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
headlines<|endoftext|>Impact of the introduction of the red-eared slider (Trachemys scripta elegans) on survival rates of the European pond turtle (Emys orbicularis)⏎- Cite this article as:⏎- Cadi, A
-
would allow to be used as a concrete set accelerator⏎- No flocculation or coagulation⏎- All concretes and mortar containing steel reinforcement, post-tensioned concrete, concrete in contact with chlorides, parking structures, p
-
(four-legged vertebrates) > Reptiliomorpha > Amniota >⏎Reptilia (reptiles) >⏎Romeriida > Diapsida > Arch
-
eggs.⏎The sites anywhere the discoveries were made correspond to the upper Cretaceous, between the Campanian and Maastrichtian periods, some 70 to 83 million years ago.⏎The fossils found belong to small eggs
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1750 excites
- L22:151 weakly suppresses
- L0:1768 weakly suppresses
- L24:8 weakly suppresses
- L12:2523 weakly excites
- L20:669 weakly suppresses
- L9:183 weakly excites
- L10:2376 weakly suppresses
- L21:1786 weakly excites
- L20:2613 weakly suppresses
- L11:2497 weakly excites
- L2:682 weakly suppresses
- L6:1419 weakly suppresses
- L21:2566 weakly excites
- L17:113 weakly excites
- L5:1851 weakly excites
- L1:2962 weakly excites
- L10:1100 weakly suppresses
- L22:2772 weakly excites
- L14:487 weakly excites
- L0:344 weakly suppresses comma after sentence-opening adverb
- L21:2399 weakly excites
- L11:2743 weakly suppresses
- L15:887 weakly suppresses
Feeds later layers
- L27:368 weakly excites
- L26:2770 weakly excites
- L26:2604 weakly excites
- L27:1068 weakly excites
- L26:2869 weakly excites
- L26:1925 weakly excites
- L26:1001 weakly suppresses
- L27:1972 weakly excites
- L27:2187 weakly excites
- L27:2808 weakly excites
- L26:1114 weakly excites
- L27:2641 weakly excites
- L26:750 weakly suppresses
- L27:2983 weakly excites
- L26:2297 weakly excites
- L26:519 weakly suppresses
- L26:2446 weakly excites
- L26:2892 weakly excites
- L27:540 weakly suppresses
- L26:1915 weakly excites
- L27:2975 weakly suppresses
- L26:771 weakly excites
- L26:768 weakly suppresses
- L26:1920 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ippers
- metropolitan
- รา
- meteor
- ansa
- 默
- ites
- iper
- 𝑏
- pollen
Suppresses
- _cast
- %^
- degrees
- чен
- olders
- elden
- いただく
- mates
- себе
- holm