'time' in 'for the first time'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'time' in the phrase 'for the first time'. Its opposite side is the ending 'hs' in spelled-out fractions like 'sixteenths' or 'ninths'. Turning it up gave text that wandered into unrelated topics, so the steering doesn't show the trigger clearly.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to verify proper control and operation can ensure longer system life<|endoftext|>Asking the Right Questions About Your Child's Camp⏎Sending your child to summer camp for the first time can be a difficult experience; from asking about camp size to camp cafeteria food,
-
to bring in the new school year.⏎Keeping children safe is the Olympia School District’s top priority, especially for younger students and those heading to school for the first time. Parents and/or teachers can take the following steps:⏎- Teach students not to
-
2012 - 18:30 in Astronomy & Space⏎NASA's rover Curiosity touched a Martian rock with its robotic arm for the first time on Sept. 22, assessing what chemical elements are in the rock called
-
only half the amount added in 2018. Energy storage – previously “on track” – has been downgraded as annual installations fell for the first time in nearly a decade.⏎Many of the largest sources of global emissions remain “off
-
repeated it a few times since then.⏎But there were two new dimensions of the recent flight. One, it carried a Chinese woman astronaut into space for the first time. Secondly and far more significantly, it demonstrated China's capability to conduct docking of
-
a mistake has never tried anything new.” ~ Albert Einstein⏎When we’re small children, our mistakes are applauded. Our falling-down attempts to walk for the first time are cheered by our parents, giving us the courage to get up and try again
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: 12345678910112345678910112345678910112345678910
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1/4 = 4/16 and three sixteenths is 3/16, so one quarter is greater than three sixteenths⏎no, 3/16 is less than 1/2⏎
-
to one third. One third of anything is a greater quantity than one quarter of anything, therefore, "Three-ninths" is the larger of the two.⏎One fourth is a quarter and three fourth
-
0. Compare that with the seaboard of France and England. What sort of coast is it? There were shoals and sand everywhere, blocking nine-tenths of the land altogether, and doing their best to block the other tenth where the
-
in cotton buds in such areas.⏎The boll weevil is a small beetle, measuring only about two-tenths of an inch long, commonly known to feed and lay eggs in cotton buds and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1926 weakly suppresses
- L0:950 weakly suppresses
- L1:2229 weakly excites
- L1:1162 weakly suppresses
- L0:2559 weakly excites
- L1:1207 weakly excites unclear: prepositions after nouns
- L0:532 weakly suppresses
- L1:1231 weakly excites
- L1:137 weakly excites
- L1:169 weakly excites
- L0:1300 weakly excites
- L0:444 weakly excites
- L1:382 weakly suppresses
- L0:2107 weakly suppresses
- L0:1795 weakly excites
- L0:1184 weakly excites
- L1:1803 weakly excites
- L0:2817 weakly suppresses
- L0:2110 weakly suppresses
- L1:463 weakly excites
- L0:1507 weakly suppresses
- L1:2924 weakly suppresses
- L1:2960 weakly suppresses
- L1:2594 weakly suppresses
Feeds later layers
- L4:448 suppresses
- L10:1988 weakly suppresses
- L6:1147 weakly excites
- L7:2648 weakly suppresses
- L3:1129 weakly suppresses
- L4:846 weakly suppresses
- L15:711 weakly suppresses
- L27:1213 weakly suppresses
- L9:1241 weakly suppresses
- L16:724 weakly suppresses
- L20:2970 weakly excites
- L8:2138 weakly suppresses unclear: mid-name word pieces
- L12:752 weakly suppresses
- L4:2364 weakly suppresses
- L22:2283 weakly suppresses
- L8:41 weakly suppresses
- L7:1607 weakly suppresses
- L10:2806 weakly excites
- L23:1175 weakly excites
- L10:1518 weakly suppresses
- L12:510 weakly suppresses
- L16:1746 weakly excites
- L6:323 weakly suppresses
- L22:664 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- caption
- sterol
- isen
- summary
- 强者
- تكامل
- stown
- issen
- atten
- agues
Suppresses
- ICLE
- iology
- Elvis
- ağı
- eldo
- 仗
- ANNEL
- olare
- ое
- pró