"are" starting a sentence after "There"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "are" in the phrase "There are", especially when it opens a new answer or sentence. When it was turned up, the model's replies did not visibly change in a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
How to Control the Redbay Ambrosia Beetle⏎There are no tested or proven treatments for<|endoftext|>This page is a blog post that explains what
-
explicitly state that apostates should be killed.⏎There are a number of different interpretations of these verses and hadith, and there is much
-
how are these numbers obtained? And wouldn’t everything feature UPF50+?⏎There are several factors that help determine the UPF level. Fabric content, color, weight
-
different ways that coffee can be brewed.⏎There are two main types of coffee plants. The Coffea arabica, the most common
-
Can I swim with a waterproof hearing aid?⏎There are currently no hearing aids recommended for swimming. A hearing aid manufacturer offered a swimm
-
you’re looking for ways to take your business to the next level, then don’t hesitate to explore AI options!⏎The Benefits Of AI In Blogging⏎There are many benefits to using AI in blogging. For example, automated content generation can save
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have to have thought about this, and I have to have thought about this, and I have to have thought about this. I have to have thought about this, and I have to have thought about this, and I have to have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the district courts located?⏎There are 48 district courts spread out over the whole of Sweden, from Ystad in the south to Gällivare in the north. These vary in size from having several hundred to ten or so
-
in the Dutch city of Middelburg in the hands of Hans Lippershey and Zacharias Janssen.⏎A French astronomer, Jacques Bovedere, said the possible applications of the Magnifier tube in the astronomical field in letter
-
to continue to be used in New Zealand – as it has for over 20 years already.<|endoftext|>Pushlets - Whitepaper⏎Author: Just van den Broecke⏎Date: August 6, 2002⏎Push
-
ains in Donegal, ruling west Ulster with the O'Donnells and the O'Doughertys. Boyles can also be found in Kildare and Offaly. BOYLE is one of 50 common Irish surn
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1301 suppresses
- L0:178 suppresses
- L0:1224 suppresses
- L0:1910 excites
- L0:1332 weakly suppresses
- L0:1 weakly suppresses
- L0:799 weakly suppresses
- L0:458 weakly suppresses
- L0:775 weakly suppresses
- L0:1609 weakly excites
- L0:1988 weakly excites
- L0:333 weakly excites
- L0:708 weakly excites
- L0:556 weakly suppresses
- L0:1108 weakly suppresses
- L0:1999 weakly excites
- L0:1167 weakly suppresses
- L0:1931 weakly suppresses
- L0:890 weakly excites
- L0:1787 weakly suppresses
- L0:2367 weakly suppresses
- L0:3014 weakly suppresses
- L0:1142 weakly suppresses
- L0:2726 weakly excites
Feeds later layers
- L23:2230 excites
- L16:1330 excites
- L7:2025 weakly excites
- L7:651 weakly excites
- L18:1506 weakly suppresses
- L6:156 weakly excites
- L25:1416 weakly excites
- L24:937 weakly suppresses
- L16:2519 weakly excites
- L21:1768 weakly suppresses
- L27:3023 weakly suppresses
- L4:2236 weakly excites
- L5:2120 weakly suppresses
- L10:624 weakly excites
- L17:1524 weakly excites
- L4:2440 weakly suppresses
- L2:1002 weakly excites
- L5:3061 weakly suppresses
- L24:1377 weakly suppresses
- L3:1426 weakly suppresses
- L5:318 weakly suppresses
- L3:968 weakly suppresses
- L15:1438 weakly suppresses
- L27:1137 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- many
- YT
- gt
- pard
- 限期
- るもの
- 弄
- Outstanding
- pl
- ultipart
Suppresses
- 们都
- aneously
- ingly
- ольз
- 骼
- efeller
- "-";⏎
- ==$
- zeitig
- edImage