'and' joining clauses in instructions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron switches on at the word 'and' when it links two parts of a sentence, especially in instructions or rules, such as 'unless you're a fatso and don't move' or 'Join our program and our community'. Turning it up did not produce a clear theme; the continuations wandered off into unrelated topics.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
them every day (unless you're a fatso and don't move much or use a lift each time you need to get onto a
-
1853–1930⏎Our editors will review what you’ve submitted and determine whether to revise the article.Join Britannica's Publishing Partner Program and our community of experts to gain a global audience for your work!⏎One of the
-
: no pets, carry out all your trash when you leave, be out by nightfall unless someone is hurt and waiting for assistance, no camping, and if you encounter indigenous artifacts in the caves
-
⏎- Foods that contain the following ingredients: questionable flavours, emulsifiers, enzymes, and gelatine⏎- Pig and dog⏎- The by-product of the human
-
in the streets of the capital.⏎The contents of this article is licensed from www.wikipedia.org under the GNU Free Documentation License. Click here to see the transparent copy and copyright details<|endoftext|>What is Celiac / Coeliac Disease?Tweet⏎What is
-
jumper result in 3 different Transmission curves when using⏎a Network Analyser or Spectrum Analyser with built in generator.⏎( of course you may use a generator and a hf-voltmeter or anything equivalent ... )⏎The Amplitude response looks somehow
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I don't have it. I don't have it. I think it's the first thing. I think it's the second thing. I think it's the first thing... and I just want to make a noise. I think it
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
location of the monument. Where it is not available, the satellite view is shown instead.⏎Latitude: 52.5162 / 52°30'58"N⏎Longitude: -3.0604
-
ening qualities as well as a perceived belief that it possessed healing and cosmetic properties. The gum is still used today as a spice in cooking all over the world while also serving as a key ingredient in products like toothpaste, skin lotions, and
-
watch on YouTube. A prestigious panel of scientists, astronauts and educators which include His Royal Highness Prince Sultan bin Salman bin Abdul-Aziz Al Saud, astronaut and payload specialist aboard space shuttle mission STS-51-G in 19
-
survey of the history of science from its roots in different cultures around the world through to the present day. He explores crucial milestones in scientific development and at the same time examines the enormous social and intellectual changes they initiated. Opening with a discussion of the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:135 suppresses 'or' in alternative requirements
- L10:74 excites
- L4:57 suppresses
- L7:1475 suppresses 'or' joining alternatives in lists
- L9:92 suppresses "and" or "or" joining two items
- L8:70 excites 'and' between stacked superlatives
- L5:548 excites
- L10:205 excites
- L10:901 excites
- L3:1742 weakly suppresses
- L4:131 weakly suppresses
- L3:447 weakly excites
- L1:916 weakly excites
- L10:1643 weakly suppresses
- L10:2944 weakly excites
- L7:999 weakly suppresses
- L4:291 weakly excites
- L7:2416 weakly excites
- L7:1269 weakly excites
- L10:2466 weakly suppresses
- L5:560 weakly excites
- L8:1173 weakly excites
- L5:2912 weakly suppresses
- L4:2098 weakly suppresses
Feeds later layers
- L15:1907 suppresses the word 'or' between alternatives
- L12:1454 excites
- L12:1197 excites
- L15:2203 excites
- L15:2935 suppresses
- L13:553 suppresses
- L12:2279 excites
- L13:878 excites
- L12:1094 excites
- L13:2356 suppresses
- L18:2197 suppresses
- L14:1370 excites
- L17:2166 weakly suppresses
- L12:2965 weakly excites
- L16:376 weakly excites 'or' joining alternatives
- L16:935 weakly excites
- L12:2058 weakly excites
- L16:530 weakly suppresses
- L15:449 weakly excites
- L14:1213 weakly excites
- L13:887 weakly excites
- L20:1719 weakly excites
- L16:1913 weakly excites
- L12:1452 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- zwar
- upal
- 铗
- /or
- )+(
- xac
- vows
- istringstream
- #undef
- ADM
Suppresses
- unner
- pseudo
- 这句话
- зер
- сет
- mere
- ibili
- ased
- verse
- ippo