"each" in "each other" phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "each" when it is part of a phrase like "each other" or "against each other", where the next word is expected to be "other". Turning it up made the model's writing drift into repetitive or oddly phrased text, which does not clearly relate to this word.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
too thin, it will not dissipate heat correctly and be more prone to warping.⏎The brake rotor consists of two braking contact surfaces that must be parallel with each other, or else the brakes will pulsate when they are applied. In order
-
drop will equal the sum of the voltage drops measured across each resistor separately. This tells you that both the resistors' voltage drop waveforms are in-phase with each other, since they add simply and directly.⏎Measure voltage dropped across both capacitors
-
ix more than a few pages of paper to your fridge.⏎To see this for yourself, stick two fridge magnets together, back to back. They will slide against each other in one direction. If you slide them at right angles to that, they
-
.⏎Find the area of the shaded region created by the two overlapping⏎triangles in terms of a and b?⏎Position the lines so that they are perpendicular to each other.⏎What can you say about the equations of perpendicular lines?⏎ABCD is
-
adjacent coloured cells (vertically or horizontally, not diagonally) are connected, and a shape is a group of coloured cells that are directly or indirectly connected to each other.⏎The diameter of a shape is the greatest distance between any two of its
-
too fast for most telescopes to track anyway.⏎On the day or two immediately before docking and after undocking, the Shuttle and Station will appear to be chasing each other across the night sky.⏎After moonset, between 1 and 2
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to do the matter of factly speaking about the world, and then again for the matter of the world's sake, what- more than the thing, if not to say, say, what, if at all, what- more
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
basic board with future potential built in - you can buy Arduino shields to do a wide variety of things - it doesn't have an Operating System (OS) per se. Arduino has a great deal of support for accessing the board and driving serv
-
them.⏎The exhibit tells the story of migrant farmworkers, their work, and the people who serve them, in a number of ways. Photographs, for the most part by the superbly skilled professional photographers who have been acknowledged previously, document
-
historical-linguistical issues connected with the research about the etymology of the name Kudara. Some solutions will be proposed, although not definitive for the time being, but susceptible of further reconsiderations and developments should other material relating to the
-
line. Children in these circumstances are without reliable access to food, let alone to the right sort of food to ensure healthy development of their ability to learn
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:1463 strongly excites
- L6:1122 strongly suppresses
- L9:929 strongly excites 'each' in 'each other'
- L6:1299 strongly suppresses
- L7:663 strongly suppresses
- L4:117 suppresses
- L7:919 excites
- L6:1695 excites
- L3:687 excites
- L6:2016 excites
- L8:534 suppresses
- L8:2074 excites
- L5:1387 excites
- L1:706 suppresses
- L4:2227 excites
- L8:611 suppresses
- L9:846 excites
- L9:1945 suppresses
- L4:557 suppresses
- L4:1891 suppresses
- L6:809 suppresses
- L6:108 suppresses
- L6:837 suppresses
- L7:1746 excites
Feeds later layers
- L16:1059 strongly suppresses
- L16:592 suppresses
- L18:828 suppresses
- L18:564 suppresses
- L11:1384 suppresses
- L15:1662 suppresses
- L15:2665 suppresses
- L17:2822 suppresses
- L14:713 suppresses
- L19:1204 suppresses
- L20:3066 suppresses
- L18:708 suppresses
- L17:2196 suppresses
- L18:347 suppresses
- L14:1304 suppresses
- L21:360 suppresses 'such' introducing examples
- L17:1171 suppresses
- L15:1616 excites word fragments mid-word
- L18:769 suppresses
- L19:327 suppresses
- L13:2019 suppresses
- L17:124 suppresses
- L11:513 suppresses words inside idioms and fixed phrases
- L16:1750 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- inez
- stra
- 打印
- hyper
- duk
- piè
- stadt
- 提供更多
- ine
- pattern
Suppresses
- ately
- ishly
- ingly
- imately
- icularly
- atively
- 然是
- ược
- atically
- asion