the '2' in '20th' or '21st' century
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the digit 2 in years like '21st century' or '20th century', just before the rest of the number. When turned up, the model drifted into strings of ones and number-like text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
numeracy, but they also need higher order skills in critical and creative thinking, communication and the use of technology, the skills that characterise life in the 21st century.⏎The standards start with the learner. They require every teacher of
-
emerged by chance under primitive and uncontrolled terrestrial conditions according to evolutionists, still cannot be synthesised even in the most sophisticated, high-tech laboratories of the 20th century. Not a single "transitional form", creatures which are supposed
-
development for classrooms around the world, and not so long ago, whiteboards and computer carts were also innovative. Now, almost 20 years into the 21st century, edtech is synonymous with 3D printers, robots,
-
’s just a few – I don’t want to bore you. Technology is clearly accelerating rapidly – from a crawl in biblical times, to a jog in the 20th century, to a sprint now.⏎The reason for this is simple.
-
plants indigenous to the area. Most states have<|endoftext|>A new smartphone app aims to provide a cheaper alternative to ultrasound in Africa by bringing an old technique into the 21st century.⏎"We couldn't hear anything,”
-
Vol: 21, No: 21⏎Conquering the harmful divisions in our society based on race is critical to genuine social progress in 21st-century America. But to accomplish this requires an understanding of where these divisions
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The more you have in the high end, the more you have in the low end. This is a high quality of life high end septet. I am a high quality of life in the high end, high end septet
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
our news release on the paper, Ioannidis encourages scientists to choose the best ways to reduce the biases afflicting their field: “This has to be a grass-roots movement. It has to be something that scientists believe is good for their
-
We’re spending time discussing how to move from discontentment to contentment using Contentment: Joy That Lasts by Robert D. Jones as our guide.⏎The Grass is Greener Syndrome⏎Ask yourself the question: “What do I believe would
-
a novel within the novel which is also an alternative history–this one, The Grasshopper Lies Heavy, portraying a world in which the Allies won World War II
-
parties, meaning that the demographics and history of that district make a candidate from one party nearly certain to win regardless of how<|endoftext|>By Vendor > AgBio Communications > grassland plants of south dakota and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:2819 excites
- L22:332 suppresses
- L21:1189 excites
- L19:851 excites comma inside numbers with thousands
- L20:430 suppresses
- L19:1529 weakly suppresses
- L16:11 weakly excites
- L1:805 weakly excites
- L19:359 weakly suppresses
- L2:1855 weakly suppresses
- L3:744 weakly suppresses
- L20:1908 weakly excites
- L4:2708 weakly excites
- L3:1668 weakly excites
- L9:988 weakly excites
- L19:395 weakly excites
- L10:3046 weakly suppresses
- L11:1563 weakly excites
- L17:389 weakly excites
- L1:2030 weakly excites
- L22:1959 weakly excites
- L5:2922 weakly excites
- L17:840 weakly suppresses
- L16:2433 weakly suppresses
Feeds later layers
- L25:1452 strongly excites
- L26:598 excites spot just before a year or century
- L27:180 suppresses
- L27:328 excites
- L27:902 excites
- L26:233 suppresses
- L27:294 suppresses
- L26:880 suppresses
- L27:1522 weakly excites
- L25:492 weakly suppresses
- L27:391 weakly suppresses
- L27:678 weakly suppresses
- L24:979 weakly excites
- L26:739 weakly suppresses
- L27:132 weakly excites
- L27:572 weakly suppresses
- L24:1626 weakly suppresses
- L24:413 weakly suppresses
- L24:278 weakly excites
- L25:1478 weakly suppresses
- L24:1286 weakly excites the digit 3 in dates
- L24:1528 weakly excites
- L27:530 weakly suppresses
- L25:2519 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 单位
- ctors
- �
- omers
- conde
- zą
- ounc
- אחד
- 1
- 單位
Suppresses
- MISSION
- выполнен
- rador
- unborn
- ряд
- Pi
- VII
- 使命
- حساس
- arya