the word 'National' in park names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'National' in place names like 'Grand Staircase-Escalante National Monument' or 'Everglades National Park'. Turning it up did not bring out park talk in the model's writing, so the link is only visible in the text it reads.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
fossils from Utah.⏎Below, click on the various districts (West Desert, Green River, Color Country, Canyon Country, or Grand Staircase-Escalante National Monument) to find out more about paleontology in that area.<|endoftext|>The principal
-
overlook on the rim of the Grand Canyon?⏎Point Imperial, 8,803 feet⏎How many species of mosquitos inhabit the Everglades National Park?⏎43, but only 12 bite⏎What park has the
-
get a new generation interested in using the parks, much less trying a decidedly "low-tech" activity like camping?⏎Rangers at Lake Mead National Recreation Area are trying one approach with high school students in the Las Vegas area,
-
ants were perfect and completely green and had a good amount<|endoftext|>A remarkable new species of tyrannosaur has been unearthed in Grand Staircase-Escalante National Monument (GSENM), southern Utah. The huge carnivore inhabited Laram
-
hinoceros unicorns),⏎- Pigmy Hog (Sus salvanius).⏎Over 426 bird species are reported to be found in Royal Manas National Park:⏎- Great Hornbill (Buceros bicornis),⏎- Ruf
-
the ecosystems they inhabit, protected areas still fall short of protecting species and their ecological needs. In many instances, protected areas such as Nouabalé-Ndoki National Park in The Republic of Congo do not cover the full range of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I would like to know how to do the following? What is the purpose of this exercise? Okay, so I'm trying to find out how to do the following, and I would like to know how to do the first part of the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
them.⏎The horse-back journey to Fort Assiniboine took six days. There the party once more took to canoes which were worked up the Athabasca River to Jasper House. Two days after leaving the fort, the oldest Lebl
-
.⏎The Wilkes series consists of shallow, well drained soils with moderately slow permeability. These soils
-
itzer Dam.⏎- A network of 150 miles of trails, including the Wild Oak National Recreation Trail and a portion of the Great Eastern Trail. The historic Civilian Conservation Corps (CCC) built many of the trails
-
to a place where there is a riffle in the water. Mora is located a mile from the mouth of the Quillayute River at its confluence with the Dickey River or Dickodochteda, meaning muddy water in
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2455 suppresses
- L7:1583 excites
- L3:3042 suppresses
- L3:1216 suppresses
- L5:1805 suppresses
- L7:2529 suppresses
- L7:373 weakly suppresses
- L4:1376 weakly excites
- L6:1886 weakly suppresses
- L6:1742 weakly suppresses
- L6:2657 weakly suppresses
- L7:833 weakly suppresses
- L6:1091 weakly suppresses
- L6:1850 weakly suppresses
- L6:17 weakly suppresses
- L7:795 weakly excites
- L7:1470 weakly suppresses
- L7:2524 weakly suppresses
- L6:1437 weakly excites
- L7:1203 weakly excites
- L6:16 weakly excites
- L7:528 weakly excites
- L6:870 weakly excites
- L3:1343 weakly suppresses
Feeds later layers
- L21:2075 excites
- L23:1505 excites
- L18:1674 excites
- L11:1994 excites
- L10:2261 excites
- L21:2953 excites
- L10:1692 excites
- L22:2712 excites
- L10:2496 weakly excites
- L20:1063 weakly excites
- L22:3023 weakly excites
- L20:2734 weakly excites
- L23:1082 weakly excites
- L12:2395 weakly suppresses
- L18:2756 weakly excites
- L18:895 weakly excites
- L19:1522 weakly excites
- L26:995 weakly excites
- L22:938 weakly excites
- L12:993 weakly excites
- L9:3070 weakly suppresses
- L10:1720 weakly suppresses
- L11:549 weakly suppresses
- L26:1944 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 站点
- aint
- facilities
- 机
- 基地
- iere
- rove
- Server
- 设施
- ivel
Suppresses
- шедш
- danced
- 액
- ⇑
- ’d
- ナー
- >b
- ós
- bic
- endant