autumn and fall season words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the words fall and autumn when they mean the season. Turning it up did not clearly bring out seasonal text, though it did produce some weather talk.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
The pumpkin patch will be watered and pampered until fall when each pumpkin will then be boiled, baked, and blended in the school kitchen
-
. Winter frosts are rare in the coastal region, but not uncommon in the inland valleys and foothills. Except for very rare Summer or Fall rainstorms, almost all precipitation (approximately 85 percent) occurs during the
-
. Thus for the first time in the world, tektites were found in the meteorite crater.⏎Kazachstan met us with good shiny weather. Autumn only began to come to this country.⏎I traveled there with my friend Serge.
-
These crops include the following:⏎Good winter hardy crops for central Piedmont⏎Good germination in mid-August:⏎As we start setting planting dates on our fall calendar, we notice that many vegetables have planting dates that are in mid-August
-
often in juniper-oak woodlands, grasslands, and dry deserts.⏎Pads, flowers, and fruits⏎Flavonoids, octadecadienoic acid, and hexadecanoic acid⏎Most species of
-
their weight, ie they tend not to stick totally upright on the ends of the stem. Nodding thistle is a biennial weed, typical establishing in autumn in pastures that have been damaged by drought over summer. In autumn with the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: 2/01.02.03.04.05.06.07.08.09.09.010.01.01.01.01
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
0 degrees C).⏎Electrostatic spark discharge results from the internal molecular friction that generates high-voltage electric charges such as where
-
of one of the numbers, and then sum the results together.⏎There is a single positive integer T on the first line of input (equal to about 1000). It stands for the number of expressions to follow. Each expression consists
-
that people would vote against it because they didnt like him,⏎was a slave owner but disagreed with slavery; wrote a paragraph in the Declaration that Slavery should be abolished.⏎Jefferson asked ___ ___ for advice because not all of the states agreed to
-
just asfast. Compared to 1980, many more countries in the world are democratic today.⏎The last quarter century also saw wide acceptance of free market policies in both rich and poor
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:1109 excites
- L0:1400 suppresses
- L5:269 weakly suppresses
- L4:320 weakly excites
- L3:279 weakly excites
- L4:667 weakly excites
- L6:224 weakly suppresses
- L1:2358 weakly suppresses
- L5:1036 weakly excites
- L4:3001 weakly excites
- L3:1045 weakly suppresses
- L4:571 weakly suppresses
- L0:822 weakly suppresses
- L2:2053 weakly excites
- L0:948 weakly suppresses
- L4:2189 weakly excites
- L4:106 weakly suppresses
- L3:1921 weakly excites
- L5:1662 weakly suppresses
- L6:2246 weakly excites
- L5:417 weakly suppresses
- L2:752 weakly suppresses
- L5:2905 weakly excites
- L5:2280 weakly excites
Feeds later layers
- L10:1271 excites
- L9:275 suppresses
- L10:1546 excites
- L11:553 weakly excites
- L13:798 weakly suppresses
- L9:1298 weakly excites
- L9:657 weakly excites
- L11:2019 weakly excites
- L19:879 weakly excites
- L10:343 weakly excites
- L10:1284 weakly suppresses
- L25:1756 weakly suppresses
- L8:41 weakly excites
- L9:1032 weakly suppresses
- L9:2323 weakly suppresses
- L12:1381 weakly suppresses
- L10:110 weakly excites
- L25:1587 weakly excites
- L13:1315 weakly excites
- L12:641 weakly excites
- L17:2492 weakly suppresses
- L12:1759 weakly suppresses
- L13:1386 weakly suppresses
- L10:1457 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- markt
- iers
- nok
- Devils
- -placement
- OfYear
- -period
- pau
- fur
- mund
Suppresses
- 营商
- ologue
- insic
- panion
- .Singleton
- _TM
- CActive
- assoc
- ogens
- uder