the phrase 'by the time'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word "time" when it comes after "by the," as in "by the time Nixon reimposed." Turned up, the model wrote more about time and timing, such as "the time was too late." It is slightly negative on country and place names that follow "in" or "Holy," like Korea and Land.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the price — but not until after he’d coasted to a landslide re-election in 1972 over Democratic Sen. George McGovern.⏎By the time Nixon reimposed
-
for a Russian prince. News of the child prodigy spread quickly; his first compositions were published in a Warsaw newspaper, and he was famous outside Poland by the time he was 15.⏎Chopin’s first teacher was a man named
-
her bicep in the air, saying "...We Can Do It!". Or the the poster warning against spies with "...Loose Lips Sink Ships".⏎By the time you have completed our puzzle, you'll be, once again, very proud of
-
a relatively rural area before World War II. There was a large influx of servicemen for training during the war, industry like ship building occurred, and by the time the war was over, we’re getting into what’s considered modern Florida.”⏎According
-
66, but it was the oil crisis of 1973/74 that ended the "economic miracle" once and for all. By the time Herbert Grünewald succeeded Kurt Hansen as Management Board Chairman following the 19
-
Army's Corps of Topographical Engineers surveying the southwestern and northwestern boundaries of the United States as well the potential routes for a transcontinental railroad. By the time of the Civil War, an ocean-to-ocean American empire with borders clearly defined
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the best way to manage the risk of a health condition. The primary focus is on the organization that the individual is responsible for. The person who is responsible for the health care coverage, and the individual is responsible for managing the risk of a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Nurses, Carolyn Henderson, ORGANIZING THE PROFESSIONS FOR⏎Volunteering For Risk: Black Military Women Overseas during⏎the Wars in Korea and Vietnam - Tells how<|endoftext|>Students know best⏎Who knows best about how your
-
additional 670,846 were wounded. They were committed to victory, no matter the personal cost.⏎Since then, our soldiers have fought in Korea, Vietnam, Grenada, Panama, the Balkans, Afghanistan, Iraq and
-
which became the seat of the theological faculty of Paris, the most illustrious seat of learning in the medieval period.⏎He led the Seventh Crusade to the Holy Land in 1248–50 and died on
-
water.⏎To suggest in any way that bottled water is less stringently regulated than tap water is simply not true...<|endoftext|>By the time the allies landed in Normandy on June 6th, 1944, they had achieved near
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2332 excites
- L6:7 suppresses
- L6:3067 weakly excites
- L4:2608 weakly suppresses
- L5:1431 weakly suppresses
- L4:864 weakly excites
- L6:1857 weakly excites "until" after a negated clause
- L2:621 weakly suppresses
- L5:2864 weakly excites 'time' in 'for the first time'
- L6:2390 weakly excites
- L6:2277 weakly excites
- L5:1406 weakly suppresses
- L4:1817 weakly suppresses
- L0:2731 weakly excites
- L5:3046 weakly suppresses
- L5:2930 weakly suppresses
- L5:2832 weakly suppresses
- L4:134 weakly excites
- L2:2971 weakly excites
- L4:589 weakly suppresses
- L5:315 weakly suppresses
- L4:314 weakly suppresses
- L2:2045 weakly excites
- L5:2457 weakly suppresses
Feeds later layers
- L11:2600 excites
- L8:1808 weakly excites
- L9:2391 weakly excites
- L11:632 weakly suppresses
- L11:1609 weakly suppresses
- L10:2712 weakly suppresses
- L18:2782 weakly suppresses
- L10:1544 weakly suppresses
- L9:2795 weakly suppresses
- L9:465 weakly excites
- L14:1847 weakly suppresses
- L22:935 weakly suppresses
- L9:2217 weakly excites
- L15:728 weakly suppresses
- L12:718 weakly excites
- L19:3070 weakly excites
- L20:309 weakly suppresses
- L9:1089 weakly excites
- L10:468 weakly excites
- L11:239 weakly excites
- L17:682 weakly excites
- L25:252 weakly suppresses
- L14:1662 weakly suppresses
- L11:2311 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 빅
- later
- pack
- лин
- iese
- iles
- ikal
- oras
- افة
- mł
Suppresses
- aida
- Weiner
- ito
- 瑑
- awy
- =F
- annunci
- éro
- сог
- =R