"the" after "percent of" or "a lot of"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "the" in phrases like "30 percent of the", "a lot of the" or "all the", where a quantity is followed by "the" and a noun. Its negative side shows up on parts of the word "alpine" and "Alpine", which is a different pattern. Turning it up did not produce a clear change in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the people Israel and responds. The plagues used to dislodge the Hebrew slaves are physical indicators of God's personal involvement. Admittedly, not all the Hebrew slaves were liberated from their miserable environment. Over the span of several hundred years
-
report suggests Hawaii will see nearly a one-meter rise in ocean levels by the end of this century. It predicts that more than 6,000 of the state’s buildings and 20,000 people across all of Hawaii
-
Mediterranean’s fish and mollusk species can be found. Nevertheless, these too are threatened by fishing, which sometimes uses illegal methods. Almost 30 percent of the world’s fish species are either extinct or facing extinction.⏎Visit the YAB Gallery
-
morphine activates it. When she gave morphine to mice that couldn't make beta-arrestin, they were still numb to pain, but a lot of the negative side effects of the drug were missing. They didn't build tolerance to the
-
developed a process to manage change⏎China’s Change: The Greatest Show on Earth is not a claim for Chinese exceptionalism, indeed quite the opposite. Almost all the 20 essential ideas it identifies are the same or very similar to
-
steps on the moon, meaning the United States had beaten Russia in the space race, but it also led to new changes back down on Earth.⏎“A lot of the things we developed to engage in the space race and space exploration eventually filtered down to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first and the second. The first and the second. The first and the second. The first and the second. The first and the second. The first and the second. The first and the second. The first and the second.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
about how acid rain badly affected rivers with salmon (Salmo salar) and lakes with trout (Salmo trutta) and char (Salvelinus alpinus). Also from the Adirondack Mountains in northeastern USA came reports of
-
the cause of one of the botanical mysteries of the Burren as the Dense Flowered Orchid is native of the Mediterranean yet here growing alongside the (Alpine) Gentian and often with Mountain
-
clothed beneath with closely adpressed hairs, and bright yellow, somewhat tubular flowers, usually produced in fours.⏎C. DECUMBENS.—A charming alpine species, of low, spreading growth, bright-green three-parted leaves, and
-
organisms, but they are quite the opposite. My specific interests are related to species’ responses to environmental change, and alpine plants provide an incredible system to understand changes in range margins and community composition in response
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1075 weakly excites
- L2:115 weakly excites
- L2:111 weakly suppresses
- L2:1539 weakly suppresses
- L2:483 weakly suppresses
- L2:49 weakly suppresses
- L1:2401 weakly suppresses
- L2:1657 weakly excites
- L0:2790 weakly excites
- L1:1303 weakly suppresses
- L2:2692 weakly excites
- L0:191 weakly suppresses
- L0:1493 weakly excites
- L2:549 weakly suppresses
- L1:2423 weakly suppresses
- L0:1740 weakly excites
- L2:1036 weakly excites
- L0:212 weakly excites
- L1:861 weakly suppresses
- L2:1395 weakly excites
- L1:189 weakly suppresses
- L1:585 weakly excites
- L1:2268 weakly suppresses
- L2:2348 weakly excites
Feeds later layers
- L4:2754 excites
- L6:586 excites
- L7:224 excites
- L18:2621 weakly excites
- L4:731 weakly excites
- L10:2536 weakly excites
- L25:1485 weakly suppresses
- L14:854 weakly excites
- L23:2893 weakly excites
- L12:1364 weakly excites
- L9:284 weakly suppresses
- L13:2758 weakly suppresses
- L14:2871 weakly suppresses
- L17:2348 weakly excites
- L20:566 weakly excites
- L9:656 weakly excites
- L15:2944 weakly excites
- L19:1900 weakly excites
- L12:3015 weakly suppresses
- L11:233 weakly excites
- L8:1029 weakly excites
- L14:376 weakly excites
- L13:3024 weakly suppresses unclear: verbs and particles mid-phrase
- L19:832 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- odos
- enge
- OfWork
- iments
- lectron
- ],[
- ahun
- éné
- aceut
- )][
Suppresses
- formik
- Turks
- itori
- 岗
- …”⏎⏎
- .rank
- TKey
- 理会
- →renderer
- ictionary