"and" after a contrast or pause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "and" when it starts a new main clause after a comma, semicolon or a word like "however", as in "the results are surprising, and will provoke debate". Steering did not produce any clear related writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
had attended a Gael-Linn language enrichment course, but the rest had little or no exposure to Irish. The results of this research are both striking and surprising, and will provoke fresh debate on the role of the Irish language in Northern Ireland today.
-
. He was tall, erect, and of fine physique. For a few moments they carried on what appeared to be a friendly conversation, much to our relief; and then the entire group started down the road toward us.⏎It was not difficult to
-
the reef to establish a coaling station while avoiding the high-taxes imposed at ports controlled by the Hawaiians. The project was an utter failure, however, and while evacuating the last of the workers, the USS Saginaw ran ag
-
on or transgene insertions. This is not believed to be a widespread phenomenon in mammals, however, and you don’t need to (and shouldn’t!) take my word for it –
-
had captured from the Turks, ordered up General Cathcart’s brigade to prevent them from effecting their object. Some delay occurred before the brigade began its march; and the Commander-in-Chief, seeing that the Russians would succeed in carrying off the
-
, Indians killed a third of the one thousand settlers in Virginia. Another serious attack came in 1644. The English colonies grew rapidly, however, and after about 1650 had much larger adult male populations than the Indians
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "10, 20, 30, 40, 50, 60, 70, 80, 90, 100, 101, 1
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
work on the structure of the virus shells and identification of mutations to improve their stability was carried out by Professor David Stuart and his team at Oxford University using Diamond Light Source, the UK's national<|endoftext|>Coronavirus (COVID-19) and
-
and life science director at Diamond Light Source, and Dr Bryan Charleston of The Pirbright Institute. The findings are published in
-
use of epoxy-based resins and may be classified as the thermosetting epoxide polymer. Exteriors that receive this coating are resistant to ultra-v
-
y pen, or this mini plasma cutter.⏎Continue reading “Hacked CCFL Inverter Becomes An Arc Lighter
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:57 suppresses
- L5:548 excites
- L4:1529 excites
- L3:2565 weakly excites
- L4:2601 weakly excites
- L5:131 weakly suppresses
- L3:652 weakly suppresses
- L4:1927 weakly suppresses
- L4:131 weakly suppresses
- L2:1008 weakly suppresses
- L3:2453 weakly excites
- L2:1354 weakly excites
- L3:229 weakly excites
- L5:1522 weakly suppresses
- L1:1250 weakly suppresses
- L0:1397 weakly excites
- L2:3006 weakly excites
- L5:2131 weakly excites
- L1:2160 weakly suppresses
- L4:2996 weakly excites
- L3:1194 weakly excites
- L5:1653 weakly excites
- L0:19 weakly excites
- L1:2577 weakly excites
Feeds later layers
- L8:410 excites
- L16:1112 excites
- L7:93 excites
- L16:797 suppresses
- L9:103 excites "as" or "since" giving a reason
- L7:751 suppresses
- L7:377 excites
- L17:839 excites
- L8:361 excites
- L19:2073 weakly excites
- L9:161 weakly excites
- L7:259 weakly suppresses
- L7:337 weakly excites
- L16:949 weakly excites
- L24:2486 weakly excites
- L9:2302 weakly excites
- L18:229 weakly suppresses
- L8:3048 weakly excites
- L20:122 weakly suppresses
- L18:867 weakly excites
- L10:1449 weakly excites
- L12:1285 weakly excites
- L12:1200 weakly excites
- L23:373 weakly suppresses 'to' after a noun or adjective
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- acja
- 糜
- MLS
- amsung
- 它可以
- ilst
- 秣
- 到这里
- ,it
- 这是一种
Suppresses
- ObjectId
- [date
- Confeder
- اه
- degree
- 限度
- 厚
- 施行
- cido
- adj