'the' starting an object phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron lights up on the word 'the' when it comes right after a verb or preposition and starts the thing being acted on, like 'consumed the glucose' or 'evaporate the water'. Turning it up made the model's writing drift into rambling, off-topic sentences, so the steering effect is not very readable.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
after generation, for twenty years (he deserves some marks for persistence!). The culture medium had a little glucose but lots more citrate, so once the microbes consumed the glucose, they would continue to grow only if they could evolve some way of using
-
an apple orchard. York’s unit was feverishly digging foxholes as the men heard the shells edging closer. “And then bang!—one of the big shells struck the ground right in front of us and we all went up in
-
ure_ is indeed an old word, but, I think, always applied to things, never to persons.⏎Maybe get a guard dog as well to keep out the money grubbing terrorists!. .there are just too many perfectly good homes going to
-
inator. This will filter the mud from the water, which will then flow into the desalinator. There will be a heater within the base to evaporate the water, leaving the salt on the bottom. The water will condense and flow
-
use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.<|endoftext|>- Major Systems >⏎- The Plumbing Rough-In
-
Spread seed with a drop, broadcast, or handheld spreader.⏎- At low seeding rates, sawdust, sand, or other suitable material mixed⏎with the seed aids in obtaining uniform coverage.⏎- Cover seed to a depth of 1
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of the month of January, which is the first, and it is first; it is, as you might, seen, by the; and, in the same; of; and; of;; -; -; -
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
JSTOR JSTOR is part of ITHAKA, a not-for-profit organization helping the academic community use digital technologies to preserve the scholarly record and to advance research and teaching in sustainable ways ... Types of Sources for
-
culture to think of heat as risky,” said Bernstein, a pediatrician at Boston Children’s Hospital and co-director of the Center for Climate, Health, and the Global Environment at Harvard’s School of Public Health.⏎As global temperatures rise and extreme
-
supply chains over the edge.⏎Water is an unseen, vital input for all economic activity. Beyond agriculture, water is critical for power generation, mining, industry and the consumer products we rely on every single day. Like the estimated 300
-
human health. By supporting and applying epigenetics research on a national scale, CEEHRC is harnessing its great potential for major breakthroughs in understanding the origins of health and also the etiology, treatment and prevention of many of the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:120 strongly suppresses
- L9:662 strongly suppresses
- L10:1377 strongly suppresses
- L11:1168 strongly excites
- L4:73 strongly suppresses
- L15:888 strongly excites
- L16:792 strongly excites "the" inside a prepositional phrase
- L16:652 suppresses
- L16:419 excites
- L9:2198 excites
- L16:1594 excites
- L9:24 excites "the" before a named organisation or title
- L13:1234 suppresses
- L11:875 suppresses
- L15:1888 excites
- L2:205 excites
- L10:1644 excites
- L16:2248 suppresses
- L16:2062 excites "other" and contrast words
- L10:1162 excites
- L10:321 suppresses
- L15:1848 suppresses
- L15:2253 excites
- L3:344 excites
Feeds later layers
- L18:641 suppresses
- L18:799 suppresses
- L20:932 weakly suppresses 'of' after a count or quantity
- L19:3016 weakly suppresses
- L19:1744 weakly suppresses 'the' in mid-sentence noun phrases
- L18:2411 weakly suppresses
- L18:745 weakly excites
- L18:1782 weakly suppresses
- L19:2982 weakly excites
- L18:2370 weakly suppresses
- L19:2208 weakly suppresses
- L24:1410 weakly excites
- L19:2119 weakly suppresses
- L18:134 weakly suppresses
- L23:1966 weakly suppresses
- L23:1235 weakly excites
- L18:2651 weakly suppresses
- L20:2238 weakly suppresses 'the' in 'on the other hand' phrases
- L24:957 weakly excites
- L23:2578 weakly suppresses
- L19:566 weakly excites
- L19:2309 weakly suppresses
- L19:2356 weakly excites
- L23:24 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- تف
- Cran
- specialchars
- 车型
- Vit
- */,⏎
- Carolyn
- ادة
- Acer
- ホーム
Suppresses
- izzato
- 印象
- 的印象
- 记
- ksi
- 嗓子
- ana
- unate
- unu
- rias