end of document boundary
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the invisible 'end of text' marker that separates one web page from the next, right after a finished document. Its negative side is ordinary sentence endings in the middle of text. Turning it up did not produce a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
if you need to, you can always buy college assignments online.<|endoftext|>Breaking research news from a team of scientists led by Carnegie's Ho-kwang "
-
education after they reach puberty. “Many parents don’t want men to teach their daughters,” said Pushpa Kumar, the Okhla’s center’s teacher.<|endoftext|>When we begin to talk about "deferred" items in relation to accounting transactions
-
civil administration, but for ecclesiastical purposes remained part of Aker's parish. Aker borders Bymarken on the west side of the......<|endoftext|>Tell Time (Grade 2)⏎Videos and songs to help Grade 2 students
-
.⏎For severe low blood sugar, your child may need a glucagon injection. Ask your child’s healthcare provider about glucagon emergency kits for home and school.<|endoftext|>|This article needs additional citations for verification. (July 2012
-
”? Not at all, says Wolf. Instead, she argues, “The great challenge now is to learn how to use both print and digital mediums to their best<|endoftext|>- A Tale of Two Brothers: Haiti’s Other Revolutions⏎Sévère
-
the 1950s is strongly indicated. At that time, colour photography existed, but was not as widely popular and affordable as black-and-white.<|endoftext|>Classification
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the problem of the country's issues of the time (i.e., the problems that are not known, not known at all at the time, that are not known at all at the time, not known at all at the time at the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the date he received his first ever job (September 26, 1855) every year and he considered the date more important than his birthday. “All my future seemed to hinge on that day,” he reminisced later in
-
⏎Create Volcano (or Atoll) martix. It is an extension of Bullseye matrix problem.⏎Who has power to do everything in this world?⏎Close MATLAB with keyboard⏎Find the treasures in MATLAB Central and discover how the community
-
vanizing and when to use one or the other. Or even both!⏎Contact Minnesota Industrial Coatings when you’re ready to apply America’s best industrial coating solutions. We provide our customers with consistently high-quality industrial coatings.⏎Galvanizing can be
-
from the American College of Physicians are important steps towards increasing access to and availability of the data necessary for measuring equity and inequity across and within all demographic groups. The authors call for future research to unpack the complex web of factors driving health and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:235 strongly suppresses
- L16:2524 strongly excites
- L15:2544 suppresses
- L16:2510 excites
- L15:101 excites
- L9:1039 excites
- L15:774 excites
- L13:969 suppresses
- L12:2927 suppresses
- L10:2423 suppresses
- L15:1246 suppresses
- L14:242 suppresses
- L13:2022 excites
- L10:1298 excites
- L15:2249 excites
- L2:1385 weakly excites
- L16:2046 weakly excites
- L16:717 weakly excites
- L14:2827 weakly suppresses
- L16:3064 weakly excites
- L16:2200 weakly excites
- L15:2675 weakly excites
- L16:2575 weakly excites
- L15:3020 weakly excites
Feeds later layers
- L18:2322 strongly excites end-of-text token after a finished passage
- L19:2057 strongly excites
- L26:2128 excites decimal points inside numbers
- L19:1069 excites
- L27:2888 weakly suppresses
- L26:1614 weakly suppresses
- L25:808 weakly excites
- L19:1527 weakly excites
- L23:1220 weakly excites
- L20:338 weakly excites
- L26:1118 weakly excites
- L22:417 weakly excites period closing a web blurb
- L21:1150 weakly suppresses
- L21:301 weakly suppresses
- L25:2518 weakly excites
- L18:1891 weakly suppresses
- L20:44 weakly suppresses
- L20:1125 weakly excites
- L18:1082 weakly excites
- L26:2197 weakly suppresses
- L25:269 weakly excites
- L26:16 weakly excites
- L26:319 weakly excites
- L26:449 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- <|endoftext|>
- uces
- 功
- regards
- rel
- 哚
- ewn
- ただ
- ://
- ↩
Suppresses
- cul
- /OR
- QUICK
- ainers
- öst
- ROID
- èmes
- ashes
- Habitat
- anny