zero digit inside dates and codes
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the digit zero when it sits in the middle of a date or code, such as the '0' in '1999-04-19' or in an ISBN. Turning it up did not produce a clear theme in the test text, so the link to what the model writes is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Feast of Sacrifice|⏎|Saturday||September 30||Ashura||10th day of Muharram|⏎|Friday||November 03||Urs of Shah Abdul Latif Bhitai||Sindh only
-
's successor was Eurisko. http://homepages.enterprise.net/hibou/aicourse/lenat.txt.⏎Last updated: 1999-04-19<|endoftext|>There is no fixed protagonist of the novel, and consequently
-
of reception, determines your location. ["Global Positioning by Satellite"? Precison? Coverage? Web page?]⏎Last updated: 1998-02-10⏎Global Positioning System ♦ Global System for Mobile
-
/ Egg Allergies And Flu Vaccines⏎03-12-2009 / Australian Discovery May Improve Existing Vaccines⏎03-06-2009 /
-
heart health. We mustn’t ignore what we eat and how active we are, which also plays a vital role in maintaining good health.<|endoftext|>12/08 | Who was the Roman governor of Judea during the time leading up to
-
Discovery (1804-06), was commissioned by President Thomas Jefferson and funded by Congress. In carrying out
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 349-12 (12 as a card value, as a 22 card value where 22 is a 22-4, 24? 14, 42
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
snacks. Yes, regular. A new study found that people who ate chocolate a few times a week were leaner than those who ate it once in a while. The study, published in the Archives of Internal Medicine, compared the diet
-
7, when he drafted a state law to abolish slavery. The draft failed, as did a second attempt in 1785. In 1785, all state legislators except one voted for some form of gradual emancipation.
-
oietin in the brain improves exercise performance in mice without inducing erythropoiesis. FASEB J. doi:10.1096<|endoftext|>Valentine’s Day Task Cards (2nd – 4th Grade)⏎
-
of the FCC's online public file system should be directed to the FCC at 888-225-5322, at 888-835-5322 (TTY) or at email
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1795 strongly suppresses
- L5:1546 strongly suppresses
- L10:1052 strongly suppresses
- L0:44 strongly suppresses
- L1:15 strongly suppresses
- L4:498 strongly suppresses
- L1:178 suppresses
- L0:1906 suppresses
- L0:1241 excites
- L7:1337 excites 'of' inside organisation and product names
- L11:2056 excites the digit zero inside numbers and times
- L0:2302 excites
- L2:1463 excites
- L10:715 suppresses
- L1:1082 excites
- L2:1699 suppresses
- L7:342 weakly excites
- L1:2113 weakly suppresses
- L0:208 weakly excites the digit zero inside codes or numbers
- L9:977 weakly suppresses the last digit of a decade year
- L7:520 weakly excites
- L2:657 weakly suppresses
- L0:2085 weakly suppresses
- L11:1896 weakly suppresses
Feeds later layers
- L18:112 strongly excites 'over' meaning time or duration
- L17:213 strongly excites
- L20:392 strongly excites
- L18:474 strongly excites
- L20:2261 strongly excites
- L21:381 strongly excites zeros inside long number codes
- L20:2206 strongly excites
- L21:2826 strongly excites
- L19:1370 strongly excites
- L23:1324 excites
- L20:3008 excites
- L23:2981 excites
- L20:2363 excites
- L19:390 suppresses
- L19:843 excites
- L17:1046 excites
- L18:750 suppresses
- L18:288 suppresses
- L17:886 suppresses
- L18:205 suppresses
- L19:1083 suppresses
- L24:631 excites
- L26:2846 excites
- L21:2302 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ongan
- etail
- ировка
- 膝
- 椿
- قد
- entimes
- 創新
- влад
- altijd
Suppresses
- consort
- 截止
- MBED
-
- ⏎ ⏎
- ếp
- breaking
- EEEE
- UAL
- pylint