the word 'Mount' in place names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'Mount' when it begins a mountain or volcano name, such as Mount Everest or Mount Etna. Turning it up did not produce any clear theme in the written text; the output drifted into unrelated or repetitive wording.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
going to do about it?"⏎How about it?<|endoftext|>Published on Feb 20, 2013⏎CBS News RAW: A new eruption on Mount Etna occurred at its South-Eastern crater. This event generated tall lava
-
the High Plains.⏎The Rocky Mountains extend from Alaska in the North to New Mexico in the South. Mountainous regions surround high plateaux. The highest mountain is Mount Elbert 14,431 feet.
-
the mountain, failed to hear him. They stuck close to the boundary markers, determined to close in and learn what Moses had seen on his quick trip up Mt. Sinai.⏎Suddenly several huge bolts of lightning cracked down from above. Like gigantic swords
-
esite stratovolcano in the Islands of Four Mountains, a volcanic group in the Aleutian Arc. Like all stratovolcanoes, Mount Cleveland grew as explosive eru<|endoftext|>EMBL scientists use ‘mini organs’ to clarify
-
(17,400 ft); it receives an average of 450 mm (18 in) of precipitation a year. The climate of Mount Everest is extreme
-
same in both cases seems to confirm the constancy of h / c. (Annual Report of the Mount Wilson Observatory, 1935-6.) Back.<|endoftext|>I’m
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Plate台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台台
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ugs, crayfish, tadpoles and frogs and fish. They’ll also mix in some plant stuff.⏎They are ground nesters, building platforms, or mounds, of cattails or
-
. Natural shorelines are often more resilient against erosion and have more beneficial relationships to the surrounding environment and animals compared to armored shorelines, such as bulkheads, seawalls, and rock revetments.⏎Working with partner organizations and local groups,
-
standing calf raises, chest flyes and pull-down exercises on these machines. Other types of weight-training exercises require you to move your own body weight. These include triceps dips<|endoftext|>A paper clip
-
of hunters and gatherers.⏎Now, new research in the current issue of the journal Geoarchaeology, offers compelling evidence that one of the massive earthen mounds at Poverty Point was constructed in less than 90 days, and perhaps
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:1082 suppresses
- L20:1969 excites
- L15:2975 suppresses
- L22:1020 excites
- L23:1874 suppresses
- L6:2850 weakly suppresses
- L4:1048 weakly suppresses
- L7:2457 weakly suppresses
- L10:1683 weakly suppresses
- L22:938 weakly excites
- L21:2700 weakly suppresses
- L23:704 weakly suppresses
- L22:2375 weakly excites
- L24:2978 weakly excites
- L14:1448 weakly excites
- L20:2226 weakly excites
- L7:2186 weakly suppresses
- L11:1650 weakly suppresses
- L21:2499 weakly excites
- L20:2067 weakly excites
- L8:360 weakly excites
- L10:1360 weakly suppresses
- L1:2674 weakly suppresses
- L2:1516 weakly excites
Feeds later layers
- L27:2730 weakly suppresses
- L27:1115 weakly suppresses
- L26:2129 weakly suppresses
- L27:2452 weakly suppresses
- L27:683 weakly suppresses
- L26:1816 weakly suppresses
- L27:675 weakly suppresses
- L26:2083 weakly suppresses
- L26:367 weakly suppresses
- L26:1615 weakly excites
- L26:450 weakly suppresses
- L27:2003 weakly suppresses
- L26:3039 weakly suppresses
- L26:573 weakly suppresses
- L27:1885 weakly suppresses
- L27:2984 weakly suppresses
- L26:977 weakly suppresses
- L27:2373 weakly suppresses
- L27:1892 weakly suppresses
- L27:1090 weakly excites
- L27:1040 weakly suppresses
- L27:1325 weakly suppresses
- L27:446 weakly suppresses
- L27:1898 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ✏
- �回
- }}],⏎
- allis
- 殃
- нев
- phet
- ognito
- aneously
- ⏎⏎⏎
Suppresses
- 台
- 台上
- 臺
- plate
- Plate
- plates
- 板
- plates
- plate
- -platform