'years' after an age number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'years' when it follows a number describing someone's age, as in 'between 3 and 5 years of age'. Turning it down made the model repeat 'der' over and over, and turning it up gave loosely related text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
a few years later<|endoftext|>Hand-coloured lithograph entitled; 'Dampfmaschinen Pferd worauf man in einer stunde von Paris nach Petersburg reiten kann' ('Steam engine horse on which one can
-
ing Spiritualism and Materialism’, Ludwig Andreas Feuerbach wrote- “Der Mensch ist, was er ißt.” (Man is what he eats) and by this, he
-
the ptosis is not severe, surgery is generally performed when the child is between 3 and 5 years of age (the "pre-school" years). However, when the ptosis
-
’ and help to form antibodies to ‘germs’ that invade the nose, mouth and throat. This function may be important for young children up to 3 years of age, but there is no evidence that it is important after that. Studies
-
patients with longer follow-up periods. In this study, the maximum number of patients was recorded in the third decade of life, with the youngest patient 20 years and the oldest patient 55 years old. The use of transcutaneous
-
steofibrous dysplasia makes up less than 1% of all tumors that originate in bone. It usually develops in people younger than 20 years of age, and stabilizes when the bones are no longer growing.⏎Almost all
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
zeichnung der Linie des Pomeriums, zweitens der parallelen Linie der Befestigung der Arx."⏎But it is reasonably certain that Roma quadrata is also used
-
dies (i.e. Varro's description of the extent of Roma quadrata) mit dem unten erörterten Pomerium und der Auffassung des Dionys. I 88: περιγρά
-
demand.⏎The recommendations for the decontamination of FFP2 and FFP3 class respiratory masks:⏎Bewertung der Materialbeständigkeit:⏎1. High probability that the contour will remain and the material will not change
-
⏎19.01.2017 | CeMM Forschungszentrum für Molekulare Medizin der Österreichischen Akademie der Wissenschaften⏎An important step towards a completely new experimental access to quantum
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:2753 strongly excites
- L23:567 strongly excites
- L21:1718 strongly suppresses
- L22:142 strongly excites 'of' after a quantity or noun phrase
- L23:2087 strongly excites
- L20:2800 strongly suppresses
- L23:2504 strongly excites
- L23:1014 strongly excites
- L21:460 strongly excites
- L23:816 strongly suppresses
- L22:2882 strongly suppresses
- L21:2802 strongly suppresses 'of' inside set phrases like 'course of'
- L25:18 strongly excites
- L20:1356 strongly suppresses
- L19:2507 strongly excites
- L21:2749 strongly excites
- L24:994 strongly excites 'of' after a noun phrase head
- L20:2599 strongly excites
- L20:2860 strongly suppresses
- L21:2783 strongly suppresses
- L21:2966 strongly excites
- L19:2622 strongly suppresses
- L20:1917 strongly suppresses
- L22:2103 strongly excites
Feeds later layers
- L27:447 strongly excites
- L27:658 excites
- L27:1962 weakly excites
- L27:2608 weakly excites
- L27:123 weakly suppresses
- L27:1647 weakly suppresses
- L27:3065 weakly excites
- L27:1005 weakly excites
- L27:2243 weakly suppresses
- L27:1294 weakly excites
- L27:1262 weakly suppresses
- L27:2378 weakly excites
- L27:2454 weakly excites
- L27:1953 weakly excites
- L27:869 weakly excites
- L27:2028 weakly suppresses
- L27:2924 weakly suppresses
- L27:265 weakly excites
- L27:425 weakly suppresses
- L27:110 weakly suppresses
- L27:717 weakly excites
- L27:2106 weakly suppresses
- L27:393 weakly suppresses
- L27:338 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- of
- of
- Of
- →of
- _of
- Of
- .of
- -of
- _OF
- _Of
Suppresses
- der
- Der
- Der
- artner
- 湫
- 在内的
- iliar
- _der
- des
- 翻身