'and' or 'or' joining the last list items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'and' when it joins the final two items in a list, such as 'signs and symptoms' or 'wings; or ground'. When it was turned down, the model kept writing long lists joined by 'or', which suggests it helps track list-style joining words.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
latter is preferable as you can plant these in the ground and they will rot away)⏎- plastic containers – these also are takeout containers from a deli and they have the bonus of a domed clear plastic lid
-
USDA and U.S. Food and Drug Administration, raw chicken (regardless of if it’s whole; in pieces such as breasts, thighs, drumsticks, and wings; or ground) should be stored
-
to see a doctor⏎Call your doctor if you or your child has any of these signs and symptoms:⏎- A sore throat accompanied by tender, swollen lymph glands⏎- A
-
. For example: add wheels, doors, windows, lights to the car; or add details to the scene like a road, traffic light, stop sign, and trees.<|endoftext|>Coral Reefs are the “Rainforests” of the
-
of injury in a fire or other accident.⏎- Install aftermarket parts correctly. Incorrectly-installed cruise control, stereos, and other aftermarket parts may pose electrical risks that can start a fire. Make sure these
-
a report is a document that presents or communicates to a target audience the findings (results, guidelines or outcomes) of technical work that was carried out by an individual and/or group. When this definition is carefully looked at, it becomes evident that it
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: or the specific, or the specific, or the specific, or the specific, or their specific, or their own, or something, or, or, or, or, or, or, or, or, or, or, or
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
paper, or report: you'll put in too much or too little information. Don't rely on the way material was phrased in the article, paper, or report: summarize information in a new way. Don'ts Do not commence
-
arest definitions of Cap and Trade: A cap and trade system is a method for managing pollution, with the end goal of reducing the overall pollution in a nation, region, or industry. Many proponents of pollution control support the concept of cap and trade
-
you⏎determine that num is not divisible by 5 and 7, then increase⏎count by one.⏎Share your code⏎Show a friend, family member, or teacher what you've done!<|endoftext|>cigarette butts are the
-
divisions among republicans, Socialists, and leftists had permitted conservatives to come<|endoftext|>More people are donating one of their kidneys to a loved one, a friend, even a stranger, and now a move is on to make sure those donors really
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:1107 strongly suppresses
- L14:1174 strongly excites
- L14:1351 strongly excites
- L14:1834 excites
- L14:2615 suppresses
- L14:516 excites
- L14:346 excites
- L14:3034 excites
- L14:2986 excites
- L14:1500 suppresses
- L14:1571 suppresses
- L13:2939 excites
- L14:2835 suppresses
- L13:569 suppresses
- L12:660 suppresses
- L12:2393 weakly excites
- L11:119 weakly suppresses
- L13:2826 weakly suppresses
- L14:589 weakly suppresses
- L13:562 weakly suppresses
- L10:967 weakly excites
- L14:3046 weakly excites
- L14:1231 weakly suppresses
- L1:1925 weakly suppresses
Feeds later layers
- L25:41 excites
- L19:289 excites
- L23:223 suppresses
- L25:1270 suppresses
- L20:1334 suppresses
- L18:2197 suppresses
- L27:376 suppresses
- L18:2362 suppresses
- L17:2166 suppresses
- L16:2289 suppresses 'or' linking two alternatives
- L17:1897 suppresses
- L26:2473 suppresses
- L18:1786 suppresses
- L20:1599 suppresses
- L20:2307 suppresses "some" in "some kind" and "at some point"
- L21:2124 suppresses
- L17:2671 suppresses the word matter in no matter phrases
- L18:2896 suppresses
- L26:347 suppresses the 're' in self-reliant and similar
- L25:1394 suppresses
- L18:1138 weakly suppresses
- L26:779 weakly suppresses
- L16:935 weakly excites
- L16:1388 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- &r
- -
- oooo
- Orient
- 真实性
- %
- 上下
- u
- _PACK
- 上
Suppresses
- 或多
- 或是
- 或者
- 或者是
- 或者其他
- 或其他
- or
- 或
- 或
- atau