end-of-document token after web boilerplate
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron lights up on the invisible 'end of text' marker that appears where one web page or article stops and another starts, especially after citation lines and site footers. Turning it up gave off-topic text and did not show a clear meaning.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, words or ideas that would upset a reasonable person in any culture.⏎This resource is licensed by LoubeeSav⏎under the iSLCollective Copyright License<|endoftext|>|Does a 'proper' tragic hero need a crown?|⏎Christmas Eve brought
-
The above story is based on materials provided by NASA's Marshall Space Flight Center. Note: Materials may be edited for content and length.⏎Cite This Page:<|endoftext|>By A. M. Sullivan⏎CHAPTER IX. (continued)⏎From the Atlas
-
He points out the effort of educational institutes who have created awareness and encouraged the students to report<|endoftext|>Farmers in designated Nitrate Vulnerable Zones (NVZs) are to have the amount of manure they can spread on fields slashed as Def
-
issues."⏎Materials provided by Indiana University-Purdue University Indianapolis School of Science. Note: Content may be edited for style and length.⏎Cite This Page:<|endoftext|>Briers, Mississippi facts for kids⏎Quick facts for kids⏎|Elevation
-
this word list.⏎List shorter words within focus, sorted by length⏎All words formed from focus by changing one letter⏎Browse words starting with focus by next letter<|endoftext|>I was listening to Brooke Gladstone's ON THE MEDIA podcast about the difficulty of
-
110,000 wildlife and science products⏎Multi-currency. Secure worldwide shipping⏎Wildlife, science and conservation since 1985<|endoftext|>A new study recently published showed that for women who are overweight, moderate weight loss
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I can't be sure. But I can't get to the top. That's not the problem, but I don't know, I can't get to the top. Wait, that's not the problem, maybe it's something else
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a thousand years to decompose.⏎Scientist strengthened a cow milk protein, casein, with clay and glyceraldehyde (a triose monosaccharide). They chose casein, already popular for use in adhesives, because
-
Palliser, dans la Terre de Kerguelen [on sheet with] Plan du Havre de Noel, dans la Terre de Kerguelen, by Cook/Benard, from Atlas du Troisi<|endoftext|>One of
-
puritan society. In his novel,The Scarlet Letter, Nath<|endoftext|>What they learned after only seven years is worth remembering (or learning, as the case may be).⏎The United States has operated under two constitutions. The first, The Articles
-
,000 die.⏎- MRSA: A Superbug Super Villain This is MRSA, or methicillin-resistant Staphylococcus aureus, a pervasive superbug that causes infections ranging from mild skin infections to serious infections
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:1177 strongly excites
- L9:192 strongly suppresses
- L6:145 strongly excites
- L9:136 strongly excites
- L10:228 strongly suppresses
- L4:317 strongly excites
- L4:69 strongly excites
- L10:295 strongly suppresses
- L9:700 suppresses
- L11:112 suppresses
- L9:94 suppresses
- L1:459 excites
- L8:334 suppresses
- L4:535 suppresses
- L9:322 suppresses
- L6:62 suppresses
- L9:235 suppresses
- L9:236 suppresses
- L3:721 suppresses
- L8:454 suppresses dash starting a new list item
- L10:443 excites
- L9:72 suppresses
- L2:222 excites
- L9:10 suppresses
Feeds later layers
- L18:142 suppresses
- L14:718 excites
- L15:306 excites
- L17:884 excites
- L19:821 excites
- L16:578 excites
- L26:823 excites
- L16:443 excites
- L16:612 weakly suppresses
- L15:981 weakly excites
- L14:931 weakly suppresses
- L14:1998 weakly excites
- L14:2895 weakly excites
- L18:625 weakly excites
- L14:553 weakly excites
- L16:413 weakly suppresses
- L14:933 weakly excites
- L16:2994 weakly excites
- L15:2277 weakly excites
- L25:1149 weakly excites
- L18:1219 weakly excites
- L16:417 weakly suppresses
- L14:137 weakly suppresses
- L23:2859 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ệu
- mond
- vant
- amel
- doses
- avan
- phận
Suppresses
- ��
- 窠
- aracı
- onomy
- ering
- brig
- ὗ
- itus
- arty
- ожно