the word 'later' after a time span
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'later' when it comes after a time span, like 'three hours later' or 'down the road later'. Turning it down made the model get stuck repeating the word 'later', which shows it is tied to that word.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
sustained winds of 75 mph (120 km/h).⏎Humberto’s winds peaked at 85 mph (137 km/h) later that same day, and continued at that strength through September 12 before the
-
Antitrypsin Deficiency was on Wednesday, September 4, 2019,” said Aspilche, who lives in Belgium.⏎Later, she received a genetic analysis that confirmed her disease and genotype: ZZ. That
-
Institute and father of two of the kids, had been tending to this tree, and was worried that it had suffered irreparable damage. But when he returned later, he was in for a surprise. The holes had been
-
raised after Howard had reached Glen Valley, found Cleve and Mick.⏎Within two days the group arrived at Glen Valley where, tragically, Cleve Cole died later that night. In memory of Cleve`s life, and in recognition of his
-
Not only does this help reduce injury during sports, it will promote over all comfort and well-being. Starting this habit early will help prevent chronic back and neck pain later on down the road.⏎Although unavoidable, there are
-
might also damage nearby organs that are exposed to the beams. This could lead to problems such as heart or lung damage, or even an increased risk of another cancer later on. Doctors do everything they<|endoftext|>Variety of electromagnetic radiation with frequencies between a
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: after a later, later, later, *subsequent* *after* after, after, after, after, later, later, after, after, after, after, later, after, after, after, later, after, after
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
012.⏎Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no
-
basic treatment was developed by Lifshitz (1946), Zeldovich (1967) and Field (1974) and has been clearly incorporated in the well-known book by Weinberg (1972
-
the city, and there she became pregnant; the King decided to call the place "Pla del Bon Repos" ("Plain of good sleep"), a name that has been left to posterity and today is a suburb of Alicante.⏎In
-
assertions:⏎— The Founding Fathers didn’t considered the Declaration of independence a piece of propaganda.⏎— Thomas Jefferson didn’t say a word at the convention. And never gave a single speech as president. He would rather write than speak.⏎— Jefferson
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1994 excites
- L17:2306 excites
- L16:2387 suppresses
- L18:1941 excites
- L15:2338 excites
- L17:2441 excites
- L12:1023 suppresses
- L16:1992 suppresses
- L17:1041 excites
- L18:2817 excites
- L12:2250 suppresses
- L20:1396 excites
- L17:1416 suppresses
- L20:990 excites
- L12:2111 excites
- L17:2973 suppresses
- L17:2964 suppresses
- L20:2530 suppresses
- L13:1327 suppresses
- L10:456 suppresses
- L18:2437 suppresses
- L14:1741 weakly excites
- L10:2099 weakly suppresses
- L11:2065 weakly suppresses
Feeds later layers
- L27:2471 strongly suppresses
- L23:1256 suppresses
- L22:1056 suppresses
- L26:865 suppresses
- L24:2668 suppresses
- L27:885 suppresses
- L25:2579 suppresses
- L24:693 suppresses
- L23:1283 suppresses
- L24:810 suppresses
- L22:1244 suppresses unclear: syllables inside Sanskrit religious words
- L23:462 suppresses
- L24:433 suppresses
- L25:1396 weakly suppresses
- L26:1725 weakly suppresses
- L27:1562 weakly suppresses
- L22:1607 weakly suppresses
- L25:63 weakly excites
- L27:1006 weakly suppresses
- L26:1673 weakly suppresses
- L25:806 weakly suppresses
- L22:1748 weakly suppresses
- L27:1082 weakly suppresses
- L23:3040 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- phem
- ugg
- /tiny
- ophilia
- cura
- 奄
- vasive
- \t
- ình
- acles
Suppresses
- later
- 之后
- 以后
- 后
- afterwards
- afterward
- later
- 后的
- Later
- 後