the digit 3 inside years
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the digit 3 when it sits inside a year or date, such as 1853, 1983 or 2001-12-31. The steered outputs did not show a clear theme, so it is hard to say what turning it up does.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Scale Biosphere-Atmosphere|⏎|Time Period||1985-01-01 to 2001-12-31|⏎This data set includes classified land cover transition maps at 30-m
-
roman books⏎The works translated the following take care of significant subject matters within the considering St Augustine (354-430): loose will and divine grace. at the one hand, unfastened
-
the poor. Therefore, the people waited for the Messiah or Christ.⏎The word Christmas, or "Christes Maesse," was first used in 1038. Until then, it was known as Nativity Feast. Christmas is Latin
-
_class_altemira.tif||30.7 MB||1985-01-01 - 2001-12-31||2.50S To 4.00S||5
-
value than it does now. According to the U.S. Treasury, the closest that the nation ever was to being debt free was during the years 1835 and 1<|endoftext|>Fibromyalgia is a disorder characterized by widespread
-
of Middlebourne, may well have been the first to develop a practical method for transmitting messages over wire. His success came on March 3, 1838, more than six years before Samuel B. Morse successfully transmitted a message over
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the idea that the opposite side of the 'g' to the 'g' is the same as the 'g' to the 'g' to the 'g' (like the 'g' to 'a' to 'k'
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
University.⏎During the first project phase, three extensive field surveys were conducted along the coastline of Saudi Arabia in 2011, 2012 and 2013 in order to access the biodiversity of the nearshore and
-
Life. And a hike through that exhibit and underwater viewing tunnel brings encounters with three polar bears, a gray seal, two harbor seals, one harp seal and three arctic fox.⏎A visit to the Arctic Ring of Life is more than a
-
011.5 hours in this first year of study and recorded 671 unique contacts – 277 bonytail, 383 razorback sucker, and 11 individuals with no database record.⏎Based on
-
.S. hosted the Olympics for the first time in 1904, in St. Louis. The third Olympiad marked the first time gold, silver and bronze medals were given out to first, second and third-place finishers.⏎Starting
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1023 strongly excites the digit 3 inside numbers
- L16:134 strongly excites
- L4:347 strongly excites
- L0:1108 strongly suppresses
- L17:994 excites
- L2:1774 excites
- L2:1866 suppresses
- L19:1615 suppresses
- L18:750 excites
- L19:647 excites
- L16:671 excites
- L18:569 excites
- L19:196 suppresses
- L18:420 suppresses
- L2:1518 excites
- L15:129 suppresses
- L16:400 excites
- L15:80 suppresses
- L15:96 suppresses
- L10:1210 suppresses
- L10:722 weakly excites
- L2:1724 weakly suppresses
- L5:1984 weakly excites
- L17:134 weakly excites
Feeds later layers
- L21:1189 strongly excites
- L23:2650 excites
- L22:3071 excites
- L21:325 suppresses
- L23:1670 suppresses 'the' before river names
- L23:840 excites
- L25:2807 excites
- L26:1090 weakly excites
- L27:2850 weakly excites
- L24:2955 weakly excites
- L22:1550 weakly suppresses
- L27:2318 weakly excites
- L22:3051 weakly excites
- L26:733 weakly suppresses
- L23:2376 weakly excites
- L21:2627 weakly suppresses
- L24:2262 weakly excites
- L27:285 weakly excites
- L24:2466 weakly excites
- L25:2442 weakly excites
- L27:533 weakly suppresses
- L25:1702 weakly excites
- L25:396 weakly suppresses
- L26:1279 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rd
- rd
- -quarters
- ʳ
- →rd
- RD
- cheers
- viso
- (rd
- rgan
Suppresses
- -thirds
- stri
- ously
- thing
- strate
- fully
- Warp
- keh
- 德尔
- kee