words right before 'all' or 'in'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron tends to light up on a word that is often followed by the small words 'all' or 'in', such as 'fill' before 'in' or 'comply' before 'all'. When it was turned up, the model kept writing the word 'all' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.<|endoftext|>
-
have successfully created an account.⏎A verifications link was sent to your email at . Please check your email and click on the link to confirm your email address and fully activate your iCPALMS account. Please check your spam folder.<|endoftext|>W
-
ovsky Poland⏎Vladimir-Volynsk, Poland… Summer 1943 – Galina and Yuri
-
9 16 25.........⏎Basics: Divide integers to get integer outputs in all cases⏎Determine value using Look-up table method⏎Create Volcano (or Atoll) martix. It is an extension of Bullsey
-
license.⏎A protocol transfer⏎- You give up the ability to profit from your work.⏎- You transfer the rights indefinitely.⏎- You need to print, fill in
-
5000 copies and never went out of print.⏎This PDF is a full-text searchable reproduction of the entire issue of this publication with all images, including advertisements.⏎Gushee asks whether New Orleans deserves its central place
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: multiple life conditions, multiple life conditions, life conditions... just like life conditions... life conditions... life conditions... life conditions... life conditions... life conditions... life conditions... life conditions... life conditions... life conditions... life conditions... life conditions
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
!⏎The Great Unknown: Risk-Taking Behavior in Adolescents⏎19.01.2017 | Max-Planck-Institut für Bildungsforschung⏎A sudden drop in outdoor temperature increases the risk of respiratory
-
solar system, and some scientists think that they hold a key to understanding how the planets formed and why they are so diverse. By studying Comet 67P/C-G, researchers think they might start to learn more about how comets formed in
-
the long-standing mysteries surrounding how a comet works as it flies near the sun.⏎Here are five strange facts about Rosetta's target, Comet 67P/C-G:⏎It's going to be harpooned⏎Rosetta has been traveling
-
carried out research into the kinds of scoliosis treatments available at the time Richard was alive.⏎They included looking at 11th century Persian polymath Avicenna's theories on using traction.⏎Avicenna also advocated the massage techniques pract
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:1458 excites
- L15:59 weakly excites
- L19:1982 weakly suppresses
- L10:564 weakly excites
- L9:3013 weakly excites
- L7:92 weakly suppresses
- L0:1034 weakly suppresses
- L10:375 weakly suppresses
- L5:146 weakly excites
- L18:1601 weakly suppresses
- L1:2348 weakly excites
- L24:1373 weakly suppresses 'all' in 'all over the world'
- L19:1554 weakly suppresses
- L2:5 weakly excites
- L11:2164 weakly excites
- L16:2202 weakly excites
- L4:76 weakly suppresses
- L19:1305 weakly suppresses unclear: verbs after a noun or 'that'
- L0:2105 weakly excites
- L5:656 weakly excites
- L1:727 weakly suppresses
- L24:2705 weakly excites
- L4:2279 weakly excites
- L14:263 weakly suppresses
Feeds later layers
- L27:769 strongly excites
- L26:684 weakly excites
- L27:1781 weakly suppresses
- L27:668 weakly suppresses
- L27:667 weakly suppresses
- L27:1682 weakly suppresses
- L27:2249 weakly suppresses
- L26:890 weakly suppresses
- L27:1967 weakly suppresses
- L26:1685 weakly suppresses
- L27:1775 weakly suppresses
- L26:843 weakly suppresses
- L26:522 weakly suppresses
- L27:612 weakly excites
- L26:901 weakly suppresses
- L26:973 weakly suppresses
- L26:1810 weakly excites
- L26:2252 weakly suppresses
- L26:2502 weakly suppresses
- L27:273 weakly suppresses
- L27:2576 weakly suppresses capital N starting a name
- L27:2768 weakly suppresses
- L26:257 weakly suppresses
- L26:351 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- all
- all
- 所有
- (all
- .all
- _all
- →all
- All
- All
- ALL
Suppresses
- ляр
- multiple
- wygląda
- MULT
- ไหน
- agua
- 别的
- reement
- 火炬
- 那是