the zero digit in decimals
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the digit 0 when it appears in a decimal or a number that starts with a zero, such as 0.99 or 0.000001. Pushing it down made the model write long runs of zeros, and pushing it up made the writing drift into unrelated topics.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Fat, there are 0 grams of Trans Fat, and there are 5 grams left over.⏎Cholesterol - Watching your Cholesterol? One serving has 0 mg, which should make healthy eating a little easier.⏎Carbohydrates - Total
-
terrestrial (longwave) radiation, which is centered around a wavelength of 10μm. The absorptivity and emissivity around freezing point is 0.99 – meaning that only 1% of incident longwave radiation would
-
Library maintained by the Modelica Association.⏎This example demonstrates different noise distributions methods that can be selected for a Noise block. Both noise blocks use samplePeriod = 0.02 s, y_min=-1, y_max=3, and
-
. Freshwater entering the major estuaries is, where not contaminated, of acceptable quality for drinking with minimum treatment. However, iron concentrations in excess of 0.
-
A single heat pulse will switch the magnetic orientation of a nanometer-sized magnetic grain in just a few picoseconds (1 picosecond is 0.000000000001 seconds). As
-
E, 17.3 µg of Vitamin K, 106.488 g of total saturated fat, 0.216 g of lauric acid, 2.16
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:100000000000000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
archive.jpr.org.uk/10.1177%2F13591045050537
-
". PLoS ONE 8 (2): e57075. . . http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.
-
and%20adaptive%20immune%20system.⏎- How Vitamin C Supports a Healthy Imm
-
2017, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5707683/#:~:text=It%20is%20a%20potent%20ant
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1391 strongly suppresses
- L20:626 excites
- L4:498 suppresses
- L17:213 suppresses
- L2:1795 suppresses
- L0:208 excites the digit zero inside codes or numbers
- L3:651 excites zero in dates inside URLs
- L19:843 suppresses
- L10:1052 suppresses
- L5:1546 suppresses
- L2:1463 excites
- L16:177 excites zero digit inside dates and codes
- L14:643 suppresses
- L18:112 suppresses 'over' meaning time or duration
- L9:977 suppresses the last digit of a decade year
- L1:45 suppresses
- L18:499 weakly suppresses
- L17:367 weakly excites
- L16:84 weakly excites
- L4:622 weakly excites
- L10:726 weakly suppresses
- L15:1991 weakly excites
- L22:1713 weakly suppresses
- L19:879 weakly excites
Feeds later layers
- L27:238 strongly suppresses
- L27:1196 suppresses
- L26:216 suppresses blank slot before a year or number
- L27:283 suppresses the spot right before a number
- L26:121 suppresses
- L27:241 excites
- L26:15 excites
- L26:103 suppresses blank space before a number
- L27:48 excites
- L27:1153 suppresses
- L26:413 weakly suppresses
- L27:1117 weakly suppresses
- L26:172 weakly suppresses
- L27:862 weakly suppresses
- L26:2051 weakly excites
- L26:1538 weakly excites
- L26:667 weakly suppresses
- L27:973 weakly excites
- L27:2221 weakly excites
- L26:957 weakly excites
- L27:902 weakly suppresses
- L27:51 weakly excites
- L27:1438 weakly suppresses
- L27:1286 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- xb
- ROID
- xa
- iode
- roid
- xB
- Bedford
- aries
- х
- x
Suppresses
- 0
- 9
- 1
- 3
- 4
- 8
- 2
- 0
- 5
- 7