conjunction before the last list item
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'and' (or a similar word like 'also') when it comes right before the final item of a list. Steering did not produce a clear, consistent change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and controlling the direction of negotiations; preparing court reports, social case histories, correspondence and other documents; implementing legislative enactments and court rules relating to a case; and keeping abreast of current trends, rules and legislation.⏎Although many mediators are
-
its victim, an American tourist who apparently died after being stung by the species while swimming in Australia; a charismatic rhinoceros beetle from the Amazon; and the "Michelin Man" plant from Australia.⏎The Mindoro stripe-faced fruit
-
100 hours of supervised driving; a minimum age of 17 for a provisional license; restrictions on driving at night; limits on other teenage passengers; and a minimum age of 18 for a full license.⏎"These findings on nighttime
-
interrogative taught as a skill to assist beginning students in language use outside the classroom; using oral histories to promote literacy skills; using the newspaper with ESL students; and preparing the student for employment. A final report of the project is appended to the
-
and carefully written text. Not just that it covers important concepts in a well-detailed way, it also tells them quickly with the help of diagrams and bullets. To get the book,
-
the flag bearer, while the other soldiers were sculpted from photographs of posed Confederate soldiers. Postponed from May
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first time, so I need to do this. Wait, so I don't do that. But wait, maybe I'm not sure. Let me also check. Wait, so I don't do that. Okay, but maybe I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
direct taxes and indirect taxes ?⏎15. Explain the diminishing rate of substitution.⏎16. Give any two differences between Micro and Macro – economics.⏎17. Draw
-
before bed can have a detrimental impact on your sleep?⏎Here, we delve into the negative effects of screen time on the quality of your night’s rest. We also share some tips on how to improve your sleep pattern by reducing phone usage before you
-
neutralize certain chemicals that can damage cells. Treating the mice with a compound that mops up these chemicals restores their brain connections, the study shows. It also improves the performance of the mice on cognitive tests.⏎“It not only fixes the number
-
harness the immune system’s power to fight prostate, breast and kidney cancers and melanoma.⏎This fact sheet from the National Cancer Institute explains the subject thoroughly. It also lists a number of the clinical trials currently underway on experimental therapeutic vaccines.<|endoftext|>What
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:542 strongly excites
- L3:490 strongly excites
- L3:403 excites
- L3:308 excites
- L3:792 suppresses
- L3:419 excites
- L3:96 excites
- L3:234 excites
- L3:345 suppresses
- L3:564 suppresses
- L2:719 suppresses
- L3:775 excites
- L3:674 excites
- L2:182 suppresses
- L3:351 suppresses
- L2:942 suppresses
- L1:107 suppresses
- L3:517 excites
- L2:936 suppresses
- L2:713 suppresses
- L3:633 suppresses
- L2:227 excites
- L3:557 suppresses
- L3:274 weakly excites
Feeds later layers
- L5:286 excites
- L5:43 suppresses
- L5:473 excites
- L7:796 suppresses
- L7:25 suppresses
- L7:181 suppresses
- L6:47 suppresses
- L7:94 excites
- L7:43 excites
- L7:787 excites
- L5:177 excites
- L8:1885 suppresses
- L15:2967 weakly suppresses
- L8:169 weakly suppresses
- L5:49 weakly suppresses
- L8:2812 weakly excites
- L9:1831 weakly suppresses
- L6:1152 weakly suppresses
- L16:1075 weakly suppresses
- L8:142 weakly suppresses
- L8:510 weakly suppresses
- L13:1625 weakly suppresses
- L9:1368 weakly suppresses
- L15:2413 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- const
- 我已经
- nEnter
- 宫
- �
- изм
- 已
- 已达
- 博物馆
- 已经是
Suppresses
- 'autres
- rade
- 更重要的
- 焘
- cheid
- 重要原因
- ail
- DBNull
- 其它
- печ