ages right before a number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the spot right before an age or time number, like "between ages" or "at about" followed by a number of months or years. Its negative side fires on "at" in phrases like "at the time". Turned up, the model repeated "the first" and similar phrases.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Richeson, and such an appliance is utilized to expand that arch. The palatal expander is best used while a child is still growing, usually between ages 8 and 10.⏎"By age 7, a child will have
-
they should always wear a seat belt. Younger children should use car seats or booster seats until the lap-shoulder belt fits properly (typically for children ages 8-12 and over 4’9”), and ride in the back
-
when you feed your baby purees with a spoon, starting at around 6 months of age when they can sit up and grab things.⏎However, some
-
Tourette syndrome is a neurological condition that involves automatic, unconscious movements and utterances called tics. Tourette disorder usually begins in early childhood in the range of 3 to 9 years of age, with cases of Tourette’s occurring more
-
developed at this point yet. So they are not able to digest much solid food then apart from their mother milk.⏎After they start to wean (at about 2 to 3 months of age), you can feed them strawberries. However,
-
brands include Priadel and Li-Liquid.⏎3. Who can and cannot take lithium⏎Lithium can be taken by adults and children over the age of 12 years.⏎Lithium may not be suitable for some people. Tell
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: at the time of the at the time of the at the time of the at the time of the at the time of the at the time of the at the time of the at the time of the at the time at the time at the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
destination for wealthy guests who were looking for a luxurious retreat. The hotel boasted over 700 rooms, making it one of the largest hotels in the world at the time
-
, which took place on April 22, 1970 brought 20 million Americans – 10% of the U.S. population at the time
-
1913, by the Geographic Board of Canada. The work done by the American Bureau was monumental, well informed and incorporated the most advanced scholarship available at the time. In many respects, the information is still useful today, although pr
-
He is described as being "full of sores" and is generally thought to have been suffering from leprosy, the disease being endemic in the Holy Land at the time. Here Jesus uses the name ‘Lazarus’ in the generic
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1551 suppresses
- L14:2984 suppresses
- L11:2574 suppresses
- L9:2675 excites 'time' in 'at the time'
- L17:2964 suppresses
- L17:1895 excites
- L20:990 excites
- L19:245 excites
- L18:2984 suppresses
- L21:1083 suppresses
- L17:2544 suppresses
- L21:1309 excites
- L19:2901 excites
- L18:1505 suppresses
- L20:1208 suppresses
- L20:2347 weakly suppresses
- L14:2708 weakly excites
- L17:2922 weakly suppresses
- L18:2408 weakly excites
- L13:2502 weakly excites
- L20:442 weakly excites
- L20:3006 weakly suppresses
- L21:1729 weakly suppresses
- L18:2764 weakly excites
Feeds later layers
- L27:599 strongly suppresses
- L26:835 strongly suppresses
- L24:1252 strongly suppresses
- L24:856 suppresses
- L26:1210 suppresses
- L25:501 excites
- L24:380 excites the word 'at' in place phrases
- L23:1395 suppresses
- L26:840 excites
- L25:2448 suppresses
- L26:2537 weakly excites
- L26:1800 weakly suppresses
- L23:2703 weakly excites
- L23:476 weakly suppresses
- L24:969 weakly suppresses
- L25:633 weakly suppresses
- L23:1478 weakly excites
- L24:2000 weakly suppresses "United" in US and UN names
- L25:211 weakly suppresses 't' after a hyphen in animal names
- L27:1457 weakly suppresses
- L23:263 weakly suppresses
- L27:1315 weakly suppresses
- L23:1377 weakly excites
- L24:58 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ocr
- inati
- odus
- awa
- CADE
- AGMA
- ários
- enes
- 酐
- rysler
Suppresses
- at
- At
- At
- _at
- -at
- →at
- .at
- at
- (at
- [at