the final zero of decades like '1980s'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the last digit '0' of a decade year such as '1880s', '1970s' or '1920s', at the moment the model reads it. Turning it up did not make the text talk about years or decades, so the test did not confirm the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Pituophis melanoleucus mugitus), eastern coachwh<|endoftext|>Fair Use of Copyrighted Works by Teachers and Students⏎Since the mid-1880s, teachers and researchers have relied on an exception to copyright protection called fair use
-
rage was caught up in the newspaper business, because the press was one of the only places where women could voice their opinions. In the late 1890s and into the early 1900s, it was not considered
-
the same encryption key for every transaction hasn't been an acceptable practice since the Caesar Cipher was popular in ancient Rome. Furthermore, since the mid-1970s, the DES algorithm was known to be vulnerable to brute-force attacks because of
-
The US Congress has had oversight responsibilities over the CIA since the Agency was established in 1947. However, prior to the mid-1970s, oversight responsibilities resided in the Armed Services Committees of both chambers and were
-
city of Hollywood, Florida you’ll find a small community, populated mainly by African Americans, known by the name of Liberia.⏎In the early 1920s, a vast amount of land in this area was purchased by a gentleman named
-
Caroline had finished her studies in Sweden in the early 1880's, before moving South, to Paris, and settling in the village of Gre
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am working on a essay about a event, a person, or a idea. The essay should be in the present tense. **Context:** The event of the first century, the story is set in a ancient city, the city
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
heat to the surrounding rocks. The magma fills and widens cracks and fractures as it rises. The end result is a vertical wall, or dyke,<|endoftext|>-Why is balance important in an ecosystem?⏎-What is the relationship between living and
-
only one example of clever tricks used by cephalopods. Check out our full-length feature to find out more about these animals' astounding mental skills.<|endoftext|>- Cooking Time: 0⏎- Servings: 0⏎- Here are
-
43],. In the Sogdian sources (early 8th – 9th
-
percent of its normal value, a depression that only decayed once the pole's location stabilized.<|endoftext|>- Project plans⏎- Project activities⏎- Legislation and standards⏎- Industry context⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:404 strongly suppresses
- L1:217 excites
- L0:50 weakly suppresses
- L0:132 weakly excites
- L1:2342 weakly excites
- L0:3000 weakly suppresses
- L0:1792 weakly excites
- L2:422 weakly suppresses
- L2:1091 weakly excites
- L0:1296 weakly excites
- L1:1017 weakly suppresses
- L1:1016 weakly suppresses
- L2:228 weakly excites
- L1:1343 weakly suppresses
- L1:331 weakly suppresses
- L0:3065 weakly excites
- L1:2258 weakly suppresses
- L2:75 weakly suppresses
- L2:1727 weakly suppresses
- L2:152 weakly suppresses
- L1:2200 weakly suppresses
- L1:937 weakly excites
- L1:1062 weakly suppresses
- L0:2518 weakly suppresses
Feeds later layers
- L23:393 strongly excites
- L25:577 strongly suppresses
- L20:344 strongly suppresses hyphen inside compound words
- L8:3004 strongly excites
- L4:490 strongly excites decade digit in years like 1930s
- L20:1513 strongly suppresses
- L18:1997 suppresses
- L27:2408 excites
- L20:961 excites
- L20:1385 suppresses
- L22:265 suppresses
- L26:1008 excites
- L25:1757 suppresses
- L5:97 excites
- L23:474 suppresses
- L25:231 excites
- L21:1145 suppresses
- L4:384 suppresses
- L24:318 excites
- L25:535 suppresses commas inside number lists
- L24:248 suppresses
- L21:690 suppresses
- L22:512 suppresses
- L18:853 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- s
- ات
- es
- sut
- y
- اتهم
- sen
- sampling
- yı
- sar
Suppresses
- naire
- noch
- -contrib
- naires
- /id
- .shtml
- 缪
- -abs
- gắng
- Toll