the word 'two' after 'the other'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'two' when the text is talking about a pair or the second of a set, such as 'the other two ships' or 'these two functions'. It is a counting-of-pairs detector. Turning it up did not produce any clear link to pairs, though, so the steering output does not confirm the idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
one side of an equilateral triangle and the circle touches the other two sides of the triangle. A smaller circle touches the larger circle and. . .
-
species of bed bugs worldwide, but luckily for us, only four of them feed on human blood. Of those four, only two prefer human blood. The other two species will feed on humans if their other prey is unavailable, but these infest
-
to 14.7 meters), and they were between 8 and 16 feet (2.5 and 5 m) wide.⏎The other two ships the researchers examined were galleys — long, oared ships, about
-
require two functions in the Arduino program or sketch, which are setup () and a loop (). The rest of the functions have to be created outside the bracket with these two functions. The best syntax used in defining function is:⏎- Return type. This
-
them are three priest wearing the leopard skin (a sign of ancient priesthood). One of them burns incense and presents offerings of food and drink,⏎- The other two are about to perform the important
-
is what we call a founder: she came from the Philippines, and her genes were not represented in the North American population. She is also the mom to the two piglets running around the exhibit. Alibangbang and Hinigugma
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if I feel, if I think, if I feel, if I feel, if I feel, I could have been a Different, If I Could Have Been, I Could Have Been, If I Could Have, Maybe, I Could Have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of cell until the conditions are good for a new sponge to develop. Then the archaeocyte "hatches" and develops into a new mature sponge. The other kind of reproduction that s
-
, British Columbia, could bring only good to that area. Many island residents disagree with that conclusion. The distance between the two areas may make any proposal for a bridge cost prohibitive…⏎Extract of sample⏎There
-
legal Chinese government.⏎Since embarking on landmark reforms beginning in the late 1970s, the country has emerged from isolation to become the world’s second-largest economy.⏎Xi has made national renewal a central theme of his administration, wanting
-
know the things that should be considered when having a guinea pig at home.⏎As rodents, guinea pigs are considered large weighing approximately 700 and 1200 grams or 1.5 to 2.5 pounds
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:93 strongly suppresses
- L11:809 strongly excites
- L9:275 strongly suppresses
- L10:1722 strongly excites
- L10:215 strongly excites
- L12:1243 suppresses
- L10:1085 excites
- L7:415 excites
- L13:697 excites
- L11:467 suppresses
- L5:1109 suppresses
- L11:231 excites
- L7:284 excites
- L11:2101 excites
- L13:2603 excites
- L10:1901 suppresses
- L10:1920 excites second number in a pair
- L12:1590 excites
- L13:2006 excites
- L13:1783 suppresses
- L11:628 suppresses
- L13:1469 suppresses
- L12:1385 suppresses
- L8:336 excites
Feeds later layers
- L16:744 strongly suppresses
- L20:534 strongly excites
- L19:2186 strongly suppresses
- L17:1365 strongly excites
- L15:1097 strongly excites
- L24:890 strongly excites
- L23:1178 suppresses
- L20:686 suppresses
- L15:1708 excites
- L25:2674 excites
- L15:1740 suppresses
- L17:2127 excites
- L27:1226 excites
- L21:2789 suppresses
- L19:916 excites
- L16:1955 suppresses
- L16:3009 excites
- L23:358 suppresses
- L20:3035 suppresses
- L22:816 excites
- L16:1127 excites opening bracket after an imperial measurement
- L19:1161 excites
- L16:2403 suppresses
- L24:2090 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 双方
- 两者
- Both
- both
- 二者
- 两国
- 这两
- Both
- 两人
- 这两个
Suppresses
- ABCDE
- 九大
- ABCDEFG
- 五个
- 这几个
- ?,?,?,?,
- 这三个
- 依次
- 几家
- 的各种