end-of-document token between unrelated texts
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron mostly switches on at the hidden marker that separates one web page or document from an unrelated one. Its strongest reactions are small, and its rare strong negative reactions come from programming and language-name contexts, so it is hard to read as one clear idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
contract when it expires.⏎In the next part, we will create the simple method that creates the options contract ticker that identifies the contract in the options chain.<|endoftext|>Rayner, Hugh, Thomas, Mark, Milford, David⏎This text
-
time.⏎You should give examples from dynamic typed languages instead, e.g. clojure.⏎Here's one example:<|endoftext|>The commerce of the ancient world was gathered into the warehouses of Tyre. "
-
ressor framework will help guide management of stream fishes, and provide a better understanding of the mechanisms underlying responses of different species.<|endoftext|>The Liber Pontificalis is a book of information on th early popes
-
can include things like making sure there are enough pencils and<|endoftext|>FDA carries out asbestos tests in cosmetic talc after concerns are raised⏎“From
-
Keeping common surfaces clean, and⏎- Staying home when you are sick.⏎Currently there are no advisories restricting travel to the Arabian Peninsula or South Korea.<|endoftext|>"The most significant fact is that it will not fall from inside pressure. Only outside
-
. Here's a class called CarParts that declares a static inner class called Wheel. If we consider the real-world, we can find many objects around us,<|endoftext|>18th Jan 12 14:01<< Go back
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first and the last term in a given vector mutates to their mutative mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane mutane
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
has been proved to be a useful and expressive tool in various modern languages. In particular, many aspects of this PEP were inspired by how pattern matching works in Rust and Scala .⏎Both those languages are statically typed, which allows the compiler to
-
Marija Gimbutas, Mary, matriarchy, mythology, Robert Graves, symbols⏎In Fil
-
products. In the spring of 1934, the Franks r…⏎E-pasta adrese, uz kuru nosūtīt darba saiti:⏎Saite uz darbu:<|endoftext|>Branch of
-
But on-the-dock inspections are just a small part of how an agency like the FDA works to protect the nation's food sources, said Joe Raulinaitis, a spokesman in the agency's New England District office.⏎"It's an
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:378 strongly suppresses
- L14:2645 suppresses
- L3:2424 suppresses
- L4:794 suppresses
- L1:1825 suppresses
- L17:1159 suppresses
- L6:696 excites
- L18:1956 suppresses
- L4:2877 excites
- L18:1203 excites end of document marker
- L10:112 weakly suppresses
- L9:1489 weakly excites
- L18:1444 weakly excites
- L17:1634 weakly suppresses
- L9:214 weakly excites
- L17:1006 weakly suppresses
- L1:1877 weakly suppresses
- L17:1074 weakly excites
- L16:1509 weakly excites
- L18:569 weakly excites
- L17:343 weakly excites
- L18:491 weakly suppresses
- L16:604 weakly suppresses
- L8:16 weakly suppresses
Feeds later layers
- L23:2680 strongly suppresses
- L24:1090 suppresses
- L21:2204 suppresses
- L23:2258 suppresses
- L21:521 excites
- L24:2041 suppresses
- L22:2396 suppresses
- L23:1665 suppresses
- L24:2636 suppresses
- L21:1667 suppresses
- L22:1168 suppresses
- L20:2663 excites
- L23:2276 suppresses
- L22:2524 suppresses
- L24:1705 suppresses
- L20:1402 excites
- L21:722 excites
- L21:2593 suppresses unclear: fractions and odd characters mid-word
- L23:1809 weakly excites
- L27:2573 weakly suppresses
- L22:2181 weakly excites
- L22:2404 weakly excites
- L22:870 weakly suppresses
- L21:1317 weakly excites 'in' in 'this, in turn' phrases
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 另一边
- atever
- ¯¯¯¯
- ¯¯
- .arraycopy
- 때문이다
- nonetheless
- 偏偏
- [array
- 是韩国
Suppresses
- mut
- mut
- (mut
- _mut
- Mut
- mute
- Mut
- crate
- mutations
- (Some