the word 'just' after have or has
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "just" when it means "a moment ago", as in "has just arrived" or "had just given birth". When it was turned up, the model's writing got stuck repeating "right" in a loop.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
it settled slowly behind the northern horizon. During the sunset's final minute, this remarkable sequence of 7 images follows the distorted edge of the solar disk as it just disappears against a distant tree line, capturing both a green and blue flash. Not
-
goal was to study 40 individual animals over that time in four different categories. The specimens ranged from the plumpest adults to haggard mothers who had just given birth and from doe-eyed pups to those skinny juveniles.⏎Mellish
-
half minutes before the rover landed. In the photo, the heat shield is roughly 50 feet (16 meters) away from the spacecraft, and had just been separated about three seconds earlier.⏎The heat shield is 15 feet (
-
RSP<|endoftext|>the story? . . . the Morning Glory cloud rolls majestically above Burketown.⏎The season for Morning Glory cloud⏎formations has just begun in the Gulf of Carpentaria and glider pilots and⏎scientists
-
Rome from an extended stay in Naples, he wrote that he felt as if "he had just had a cataract removed." For the rest of his stay in Italy,
-
in the pancreas by little clusters of cells, known as beta cells. Beta cells sense when there is an excess of glucose in the blood stream, such as just after a meal, and they send insulin
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
by the National Water-Quality Assessment (NAWQA) Program of the U.S. Geological Survey (USGS).1 Chloroform and other trihalomethanes, the most commonly detected compounds, were found in about 9 percent
-
, Leptoseris cucullata, and less common Madracis formosa, M. pharensis, M. decactis, Montastraea cavernosa, Porites divaricata, Scolymia cub
-
are formed when organic carbon reacts with chlorine, a chemical used to disinfect water against pathogenic organisms. DBPs include the groups of chemicals known as trihalomethanes and haloacetic acids. Health effects from long-term or chronic exposure
-
California, Kristin Belair picks the best grapes from 50 acres of vineyards to create high-end cabernet sauvignon and sauvignon blanc wines. Both are part of a growing number
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:180 suppresses
- L21:2130 suppresses
- L21:1226 weakly excites
- L18:81 weakly suppresses
- L20:1301 weakly suppresses
- L5:204 weakly excites
- L14:1730 weakly excites
- L16:86 weakly excites
- L21:2055 weakly suppresses
- L17:3034 weakly suppresses
- L18:2764 weakly excites
- L2:1296 weakly suppresses 'yet' ending a negated clause
- L2:1611 weakly suppresses
- L4:596 weakly suppresses
- L23:1900 weakly excites
- L23:2337 weakly suppresses
- L24:2727 weakly excites
- L23:892 weakly excites "the" in "over the past" time spans
- L8:341 weakly excites
- L21:2450 weakly excites
- L20:990 weakly excites
- L2:1374 weakly suppresses
- L21:583 weakly suppresses
- L19:2223 weakly suppresses
Feeds later layers
- L27:1046 strongly excites
- L27:1740 weakly excites
- L27:2565 weakly excites
- L27:1253 weakly suppresses
- L27:2667 weakly suppresses
- L27:3014 weakly excites
- L27:2027 weakly suppresses
- L27:1392 weakly excites
- L27:1425 weakly suppresses
- L27:2735 weakly suppresses
- L27:2120 weakly suppresses
- L27:951 weakly excites
- L27:1296 weakly excites
- L27:302 weakly excites
- L27:1211 weakly excites
- L27:292 weakly excites
- L27:1883 weakly suppresses word fragments before a name, 'ma' bias
- L27:859 weakly suppresses unclear: token just before a k sound
- L27:1254 weakly suppresses
- L27:2729 weakly excites
- L27:2281 weakly suppresses
- L27:2507 weakly excites
- L27:2713 weakly excites
- L27:195 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- just
- just
- Just
- Just
- JUST
- JUST
- "Just
- .just
- juste
- justo
Suppresses
- ertino
- .firebaseapp
- _locator
- uable
- Copenhagen
- chooser
- bdb
- STONE
- 踏
- unu