connectives inside parallel lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on small joining words like 'the', 'and' or 'to' that sit between two matching things, such as 'between Greenland and Iceland to the west and the United Kingdom'. It is weaker and less consistent on other text. When turned up, the model fell into loops of repeated phrases, so the steering does not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
meetings. The geography that concerned us in the “Forgotten Waters” exercise described in this paper is the North Atlantic passage between Greenland and Iceland to the west and the United Kingdom to the east: the GIUK Gap, as it was known throughout
-
ichlids) > Pseudocrenilabrinae⏎Etymology: Sarotherodon: Greek, saros, -ou = sawdust + Greek, ther = animal * Greek, od
-
and work with the dignity befitting the importance of their task."⏎Each major program area is presented in a section, describing research, training, & product development; arts; health; and advocacy. Contents include a description of service programs for migrants
-
iii): The site of Al-Hijr bears unique testimony to the Nabataean civilisation, between the 2nd and 3rd centuries BC and the pre-Islamic period, and particularly in the 1st century AD. It
-
an evening with two renowned researchers—Richard Alley, Evan Pugh Professor of Geosciences and an Associate of the Earth and Environmental Systems Institute at Penn State, and Gavin Schmidt, Director of the NASA Goddard Institute for Space Studies—as they
-
1 northern hemisphere and 2011 southern hemisphere influenza seasons.⏎During weeks 29 to 30 (17 July 2011 to 30 July 2011), National Influenza Cent
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been reading about some people who are "not in the back of the seat to the end of the aisle to the front of the car, but in the middle of the back of the seat to the end of the aisle to the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
intersect and perpendicular lines are the lines that intersect at 90 degrees.⏎Answer: Lines with the same slope are parallel and if the slope of one line is the negative reciprocal of the second line, then they are perpendicular.⏎Let's see how
-
mixture of a few longer items and some terms of 3 to 6 characters usually gives good results. Avoid words that overlap each other, with one being contained in the other, like
-
⏎Case Western Reserve University⏎DNA in its native form is composed of two molecules that have the⏎characteristic of being complementary such that one strand associates⏎with the other in a
-
(ωt+ΦI) where Vmax, Imax are the peak values, ω is the common angular pulsation and ΦV, ΦI are the instant phase of each signal. The phase-difference can, therefore
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2808 suppresses
- L12:2346 excites
- L12:399 suppresses
- L12:925 suppresses
- L9:1449 suppresses
- L13:2888 excites
- L13:952 suppresses
- L13:622 excites
- L13:1577 excites
- L13:2525 excites
- L13:650 excites
- L14:706 excites
- L12:2662 excites
- L14:366 excites
- L14:2282 suppresses
- L12:116 suppresses
- L12:1505 suppresses
- L12:1937 weakly suppresses
- L13:1783 weakly suppresses
- L12:1212 weakly suppresses
- L14:2752 weakly suppresses
- L9:3012 weakly excites
- L6:1084 weakly suppresses
- L14:2054 weakly suppresses
Feeds later layers
- L17:1259 excites
- L16:2433 excites
- L16:1636 excites
- L17:1546 excites
- L16:2455 excites
- L16:2733 excites
- L17:2427 excites
- L18:2862 excites
- L16:492 suppresses
- L17:1880 suppresses
- L16:661 suppresses
- L16:767 suppresses
- L17:1133 excites
- L16:660 weakly excites
- L17:2002 weakly excites
- L17:1575 weakly excites
- L16:925 weakly excites
- L18:2313 weakly excites
- L16:553 weakly excites
- L19:392 weakly suppresses
- L19:2308 weakly excites
- L27:2556 weakly suppresses
- L16:2209 weakly suppresses
- L17:465 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 相反
- 来宾
- ').⏎
- npos
- ’aut
- ') ⏎
- NEY
- 'aut
- сообщает
- ) ⏎
Suppresses
- Grade
- Gr
- Gr
- within
- Grade
- grav
- grade
- ssc
- Gro
- .Gr