"and" joining contrasting pairs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "and" when it links two opposite or contrasting things, like "art and the artist" or "truth and lies". When it was turned up, the model's writing drifted into repetitive, loosely related phrases, so the steering did not reveal a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of contrasting brilliant color and shade. Some galleries insist that artists stand alongside their works during shows, juxtaposing the art and the artist.⏎Quiz: What is juxtaposition?⏎- The act of placing two
-
atism.⏎3. Instead of rigid binary opposition of truth and lies Tetraphilosophy offer an infinite continuum and constant movement from deceit to
-
sometimes found in the opposing juxtaposition of different images placed side by side. Artists place the delicate with the blunt, juxtapose complex with simple, or mingle joyful and sad. In one artist’s work, the tension between dark and light colors offers
-
God. Piper contends that "thinking is indispensable on the path to passion for God." So how are we to maintain a healthy balance of mind and heart, thinking and feeling?⏎Piper urges us to think for the glory of God. He demonstrates
-
women and girls.<|endoftext|>Microcontroller vs FPGA: Understanding the Key Differences⏎When it comes to embedded systems design, two technologies that often come up are microcontrollers and field-programmable gate arrays (FPGAs). While both serve similar purposes
-
is no need, however, to sacrifice good acoustics when selecting products for green buildings. Architects and interior designers do not have to choose between sustainability, design and acoustic needs—they can have all
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The list is a result of the system, so I will have to accept it as the next step. So I should put into a higher priority: this is the first option. The sentence: B: C = D = E = F
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of a story could support multiple interpretations. Each subject saw two eight-sentence stories of each of four types (no-cause, unbiased, biased-proximal, and biased-distal), designed to support multiple interpretations. After reading or hearing each
-
M?⏎A. Can have subnets of different sizes⏎B. Subnets must be in same size⏎C. No required of subnet⏎D. All of above⏎6-3. What does the port number in a TCP connection specify
-
= 0.02). Capture and recapture data indicated three infection dynamics: 1) negative–positive-negative infection; 2) positive–negative-positive infection; and 3) positive at all sampling times.⏎These results indicate that
-
health department and is not intended to provide diagnosis, treatment, or medical advice.⏎In this article:⏎- Fat-Soluble Vitamins vs. Water-Soluble Vitamins⏎- Vitamin A⏎- Risk Factors for Vitamin A Deficiency⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:1884 suppresses
- L9:1449 suppresses
- L11:881 excites "with" after combine, mix or react verbs
- L11:2631 excites
- L10:1232 excites
- L3:1253 suppresses
- L7:602 suppresses
- L11:2772 weakly suppresses
- L7:1399 weakly excites "to" between a starting and ending value
- L8:2999 weakly suppresses
- L7:1156 weakly suppresses
- L11:1291 weakly suppresses
- L6:1219 weakly excites
- L8:1238 weakly suppresses
- L1:2463 weakly suppresses
- L9:1820 weakly excites
- L11:1511 weakly excites
- L8:1267 weakly excites
- L11:2292 weakly excites 'than' in comparisons
- L10:1658 weakly suppresses
- L2:2851 weakly suppresses
- L5:1256 weakly excites
- L11:628 weakly suppresses
- L2:1637 weakly excites
Feeds later layers
- L13:2356 excites
- L16:686 excites
- L15:2400 suppresses
- L13:1024 excites
- L15:1733 excites
- L14:1688 weakly excites
- L14:2422 weakly excites
- L13:758 weakly excites 'and' joining a pair of options
- L13:1768 weakly excites
- L15:3021 weakly excites
- L14:602 weakly suppresses
- L18:1801 weakly excites
- L15:1134 weakly excites
- L15:1280 weakly suppresses
- L22:2455 weakly excites
- L16:1969 weakly suppresses
- L14:2079 weakly excites prepositions after comparison words
- L18:2528 weakly suppresses
- L14:2820 weakly suppresses "and" or "or" linking two counted items
- L13:951 weakly excites
- L13:2931 weakly excites
- L15:550 weakly suppresses
- L14:1134 weakly excites
- L18:2542 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ้อม
- (
- 和支持
- crets
- ics
- iative
- luent
- i
- ebp
- e
Suppresses
- tring
- ListComponent
- LayoutPanel
- ableView
- 谠
- ReadStream
- WithTag
- 当たり
- 로서
- ệnh