blank slot between a date's day and year
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the spot in a full date just before the year, such as the gap after "May 9," when the year "1862" is about to come next. It is strongest when a full date is written out in news or history text. Turning it up did not give a clear, readable change in the model's output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
security requirements of the PCI Security Standards Council. Outdated browsers do not support the requirements of modern web applications and pose significant security risks. After May 1, 2017, this browser will no longer be supported and you may experience
-
across party lines, as this photo was physical evidence of the trauma that children experience during separation. After intense pressure socially and politically, on June 20, 2018, the Trump administration reversed the policy, just eight days after
-
the Hutchinson County. The site of Stinnett was selected because it was out of the rough country along the Canadian River.⏎On July 24th, 1926, A. S. Stinnett and Joe Williams paid
-
Buffalo, Rochester, Minneapolis, Chicago, and Los Angeles.⏎Eight months after the formation of the Proletarian University of America, on May 24, 1919
-
government research money comes from. John Boylan, busy reading medical school applications, replied simply that it comes from NIH. So, on Feb. 9, 1957, Terence sent NIH his grant application:⏎Boylan's
-
They battled the elements, disease, hunger and hostile natives.⏎Many died on the journey.⏎But recording the movement of Venus across the sun on June 3, 1769, helped gauge a crucial standard of measurement called the Astronom
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "The only way I can you can't you can't you can't you can't you can't you can't you can't you can't you can't you can't you can't you can't you can't you can't
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
⏎ENERGY STAR was introduced by the US Environmental Protection Agency in 1992 as a voluntary labeling program designed to identify and promote energy-efficient products, in order to reduce carbon dioxide emissions. EPA partnered with the US Department of Energy in
-
medium" ids="2568,2567,2569,2570"]These skills enable them to increase income, in the market, and how to profitably invest their income. We have been working
-
Bookworms, and her daughter Havana, we are tackling a controversial topic that we hope will help to
-
freedom of scientific research and encourages cooperation in the service of science.⏎Article III: Parties agree to exchange research and program plans, scientific results, and scientific personnel, in the spirit of scientific cooperation.⏎Article IV: Discusses territorial claims and declares that
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:66 excites
- L0:2921 suppresses
- L3:487 suppresses
- L3:1081 excites
- L2:704 weakly excites
- L1:255 weakly excites "to" after "the best way is"
- L1:445 weakly excites document start marker token
- L0:1854 weakly excites
- L0:2877 weakly suppresses
- L3:2117 weakly excites
- L3:28 weakly suppresses
- L2:1029 weakly excites
- L0:2069 weakly excites
- L2:482 weakly suppresses
- L2:1077 weakly suppresses
- L1:1652 weakly excites
- L1:385 weakly excites "as" after "known"
- L1:2207 weakly excites
- L1:1357 weakly excites
- L1:2606 weakly suppresses
- L3:59 weakly excites
- L3:2779 weakly suppresses
- L0:610 weakly suppresses
- L3:647 weakly suppresses
Feeds later layers
- L5:2773 excites
- L9:865 excites
- L5:259 suppresses
- L7:2503 excites
- L14:859 excites
- L6:2469 suppresses
- L7:288 weakly suppresses
- L14:155 weakly suppresses sentence-ending periods in prose
- L16:1905 weakly suppresses
- L7:685 weakly excites
- L14:690 weakly suppresses
- L5:974 weakly suppresses
- L17:386 weakly suppresses
- L16:2535 weakly suppresses
- L11:58 weakly excites web address colon in urls
- L16:1595 weakly excites
- L5:1067 weakly suppresses
- L24:87 weakly suppresses
- L11:2969 weakly excites
- L11:2666 weakly suppresses
- L5:2280 weakly excites
- L18:1085 weakly suppresses full stops ending sentences
- L9:288 weakly suppresses
- L17:1779 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- bara
- 高等
- HIP
- higher
- WC
- me
- %^
- higher
- pun
- PL
Suppresses
- エネルギ
- _slave
- もらって
- ournée
- ечно
- vous
- SelectedItem
- .getSelected
- @dynamic
- -cli