decade digit in years like 1930s
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the last digit of a decade written as a year, such as the 0 in "1930s" or "mid-1960s." It stays quiet on most other numbers. Turning it up did not change the writing in a way that matches this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the same encryption key for every transaction hasn't been an acceptable practice since the Caesar Cipher was popular in ancient Rome. Furthermore, since the mid-1970s, the DES algorithm was known to be vulnerable to brute-force attacks because of
-
The US Congress has had oversight responsibilities over the CIA since the Agency was established in 1947. However, prior to the mid-1970s, oversight responsibilities resided in the Armed Services Committees of both chambers and were
-
instruction. In the mid-1930s the central government tried to culturally assimilate the local population through the process of
-
00's, and settled in Wrightstown, Bucks County where Lacey lived with his sister.⏎Early in the 1870's, Lacey sat talking in the farm house of his friend William Kirk,
-
.C.C. and the W.P.A.—most profoundly influenced their lives.⏎Assess the impact of mass media on the American culture in the 1930s.⏎What factors contributed to the nationalization of culture? What kinds of movies
-
. military to experiment with containers. First used by military traffic commands, containers were extended to commercial use in the mid-1960s. Container use has continued to grow steadily in the United States and is projected
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the three different people who are in a group. The people are all in the group. The group is in the groups. They are in the groups. I have not added anything. I have not added anything. The group is in the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
windy. It is definitely worth the trouble.<|endoftext|>Most of the discussion of the accident revolves around specific problems. There was the lack of sufficient lifeboats (enough for at most 1200 on a ship carrying 220
-
of distressing actions.⏎A single act may be considered sexual harassment if the act is severe enough. The more severe the act, the fewer times it must happen for it to
-
land if dealings with a landowner have fallen short of a contract.⏎- Adverse possession: A claim of a right in land if it has been inhabited long enough. If a person has been in possession of land for 12 years,
-
scent released from a candle when it is burning.⏎Ahhhhhhhh the glorious melt pool! A full melt pool occurs when the wax has been heated long enough to reach the edge
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:422 strongly suppresses
- L0:132 strongly excites
- L0:579 strongly excites
- L3:508 strongly excites the final zero of decades like '1980s'
- L2:404 suppresses
- L3:395 excites
- L2:2051 excites
- L1:217 excites
- L2:1091 excites
- L2:801 excites
- L0:2215 excites
- L2:1753 excites
- L1:2756 weakly suppresses
- L1:2607 weakly excites
- L0:82 weakly excites
- L3:1469 weakly suppresses
- L3:1763 weakly suppresses
- L0:2988 weakly suppresses
- L0:425 weakly suppresses
- L1:820 weakly suppresses
- L1:633 weakly suppresses 'that' after 'fact' or 'considering'
- L0:120 weakly excites
- L1:26 weakly excites
- L2:1083 weakly suppresses
Feeds later layers
- L8:3004 strongly excites
- L23:393 strongly excites
- L5:97 strongly excites
- L20:961 strongly excites
- L26:1008 strongly excites
- L27:2408 strongly excites
- L25:577 strongly suppresses
- L24:318 excites
- L21:690 suppresses
- L25:1757 suppresses
- L20:344 suppresses hyphen inside compound words
- L18:1997 suppresses
- L21:1145 suppresses
- L16:1231 excites
- L20:1513 suppresses
- L22:265 suppresses
- L25:231 excites
- L22:2060 suppresses
- L26:2003 suppresses hyphen joining two word parts
- L13:2438 excites
- L17:2748 excites
- L21:868 excites
- L27:2657 suppresses
- L25:2883 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- s
- 们
- es
- sheets
- sand
- sam
- sampling
- sie
- sut
- ات
Suppresses
- ccione
- унк
- ductory
- getCode
- sgiving
- ViewById
- $("#"
- cheme
- olution
- ONENT