'or' in alternative requirements
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'or' when it joins two options that a rule or requirement allows, such as 'certification or passed exam' or 'pens or pencils'. Turning it up made the text drift into repeated lists of options and questions, not a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Check/Engine Start⏎Oil Pressure Gauge⏎- Make sure oil pressure gauge is working.⏎- Check that pressure gauge shows increasing or normal oil pressure or that the warning light goes off.⏎- If equipped, oil temperature gauge should begin a
-
an alpha of 10%. Show your hypotheses, calculation of F* using Excel, and either the critical F value(s) or p-value, calculated by Excel, and decision. Describe the difference if one exists
-
involved in the specification, design, planning, management and maintenance of mobile and fixed radio systems.⏎A good knowledge of radio principles, a background in telecommunications engineering, or attendance on the Radio Principles course (RP1301).⏎Spectrum regulation
-
This course gives students the opportunity to examine the role and scope of volunteerism in American society. Students in the course are required to have some significant volunteer experience, or they will be required to do volunteer work during the course. Prerequisite: permission
-
face touching only the ties/straps.⏎8. After removing the face covering, always wash your hands with soap and water for at least 20 seconds or use hand sanitiser with a minimum of 60% alcohol base.⏎9
-
the class in which he or she is enrolled.⏎The HCPS Office of Exceptional Education ensures that individuals employed as homebound teachers hold a Virginia teaching certificate or be determined eligible for one
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the value of that number, and I just want to put it into the box. So, I put it in there, and of course. I think this is probably a very good time for the time. So, I am
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to see a doctor⏎Call your doctor if you or your child has any of these signs and symptoms:⏎- A sore throat accompanied by
-
the Prevention of Cruelty to Animals (ASPCA), "Animals in Entertainment" refers to any animal(s) used to act, perform, fight and/or kill for the enjoyment of humans. The term encompasses many different forms of entertainment –
-
others area.⏎To avoid the mistake, you need to understand well what kind of fertile soil. Many people have the thought that the color of fertile soil is brown or red. In fact, black fertile soil is suitable for plants with flowers, while
-
; ending in a point: as, a peaked beard.⏎- Having a sickly, thin, or emaciated appearance; drawn; said of the face or the expression.⏎from
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:108 strongly excites "or" offering a choice in web text
- L7:1475 excites 'or' joining alternatives in lists
- L8:241 suppresses
- L9:2010 suppresses
- L7:612 suppresses
- L8:2002 suppresses
- L8:1475 suppresses
- L7:127 suppresses
- L0:1882 suppresses unclear: 'high tech' and mid-word pieces
- L9:1029 excites
- L1:1710 suppresses
- L3:1200 excites
- L5:1521 excites
- L6:584 suppresses
- L9:92 weakly suppresses "and" or "or" joining two items
- L6:1614 weakly suppresses
- L9:1133 weakly suppresses
- L7:602 weakly suppresses
- L2:1259 weakly suppresses
- L7:1646 weakly suppresses
- L8:7 weakly excites
- L8:47 weakly excites
- L2:929 weakly suppresses
- L6:1415 weakly excites
Feeds later layers
- L15:1907 strongly excites the word 'or' between alternatives
- L15:2935 strongly excites
- L18:2197 excites
- L11:273 suppresses 'and' joining clauses in instructions
- L13:553 excites
- L11:900 excites 'or' in lists of alternatives
- L17:2166 excites
- L16:2289 excites 'or' linking two alternatives
- L12:2393 excites
- L12:1197 suppresses
- L15:536 suppresses
- L14:2065 excites
- L12:1187 excites
- L12:2279 suppresses
- L11:2774 excites 'least' in 'at least' hedges
- L16:1367 excites
- L12:1454 suppresses
- L11:406 excites
- L18:1138 excites
- L11:2817 excites
- L19:1343 weakly excites
- L11:2699 weakly suppresses
- L11:1861 weakly excites
- L11:2232 weakly excites 'or' in either-or choices
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- phans
- ió
- equival
- sk
- dn
- ех
- 천
- KO
- rible
- èmes
Suppresses
- agy
- ignon
- 特派
- 上年同期
- istringstream
- .clearRect
- NavController
- JsonValue
- Swinger
- FontSize