'or' joining alternatives in lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'or' when it links two or more options, like 'soap or warm water' or 'launching a product or working for'. It goes quiet or negative on 'and' in similar spots. Turning it up made the model's text drift toward unrelated topics, so the steering results don't reveal much more.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
that’s launching a new product, or they might work for<|endoftext|>Cite This Page⏎Section III (lines 1
-
frequently felt when you begin a new exercise program, change your routine, or dramatically increase the duration or intensity of your workout. DOMS is a normal response to unusual exertion and
-
analytics together seamlessly in the same application.⏎- Learn how it runs on top of Hadoop, Mesos, standalone, or in the cloud. It can access diverse data sources such as HDFS, Cassandra
-
and lifelong learners.⏎Whenever you are stuck, need a new idea, or want to learn and grow, The 5 Elements of Effective Thinking will inspire and
-
ate equipment to heat biomass, using knowledge of controls, combustion, and firing mechanisms.⏎- Assess quality of biomass feedstock.⏎- Calculate, measure, load, or mix biomass feedstock for power generation.⏎- Manage parts and supply inventories for
-
comfortable, or sugar coated, term for racism. Racism is a practice which requires belief,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the problem of a thousand viruses, and the universe. The problem of a thousand viruses is the problem of a thousand worlds, but the universe, and the world, and the world, and the world, and the world, and the world
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
- Sleeping in an awkward position⏎- Neck muscle injury at birth⏎- Burn injury⏎- Any injury that causes heavy scarring and skin or muscle shrinkage⏎- Neck muscle spasm⏎Torticollis
-
each packet and thus prevents the types of attacks that compromised WEP.⏎WPA also includes a Message Integrity Check, which is designed to prevent an attacker from altering and resending data packets. This replaces the cyclic redundancy check (CRC) that was
-
action is taken to protect the health of all Albertans.⏎You can protect yourself from all coronaviruses by:⏎- Cleaning your hands frequently using either soap and warm water or alcohol-based hand sanitizers,⏎- Covering your cough and sne
-
arms, and legs.⏎Acute Chest Syndrome: It occurs when sickling occurs in the chest. It happens suddenly when the body is under infection, fever, and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:2967 weakly excites
- L6:295 weakly suppresses
- L0:2257 weakly suppresses
- L5:2143 weakly excites
- L0:1927 weakly excites
- L5:2227 weakly excites
- L6:1376 weakly excites
- L3:433 weakly suppresses
- L4:2950 weakly suppresses
- L4:17 weakly excites
- L1:1750 weakly suppresses
- L3:1562 weakly suppresses
- L6:834 weakly suppresses
- L5:233 weakly suppresses
- L1:2593 weakly excites
- L6:647 weakly excites
- L1:2519 weakly suppresses
- L5:264 weakly suppresses
- L3:726 weakly suppresses
- L5:2246 weakly suppresses
- L3:11 weakly suppresses
- L2:2875 weakly excites 'up' after show, turn and showed
- L2:2181 weakly suppresses
- L3:250 weakly excites
Feeds later layers
- L10:135 excites 'or' in alternative requirements
- L15:2935 excites
- L8:241 suppresses
- L8:1475 excites
- L18:2197 excites
- L15:1907 excites the word 'or' between alternatives
- L10:901 suppresses
- L11:273 suppresses 'and' joining clauses in instructions
- L11:900 excites 'or' in lists of alternatives
- L13:553 excites
- L9:1066 excites
- L10:633 excites
- L11:360 excites
- L12:683 suppresses
- L10:1053 excites
- L12:836 excites
- L11:2817 excites
- L15:2203 suppresses
- L9:352 excites
- L16:1367 excites
- L17:2166 weakly excites
- L11:127 weakly excites
- L8:623 weakly excites
- L12:1094 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ner
- 其它
- 其他国家
- other
- 或者其他
- 其他人
- MAD
- 其他
- 其他的
- _Inter
Suppresses
- uly
- vetica
- auty
- ucs
- aurus
- ROID
- uring
- igned
- ур
- uality