"own" in reflexive phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is clearly about the word "own" in phrases like "their own", "its own" or "one's own". Turned up, the model kept writing "own" and "herself" and "itself" over and over, which matches what it reacts to.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
nature, since a thing cannot be its own cause. In other words, an object being the subject of its own self.⏎
-
in the world despite the most diligent and prolonged search in the fossil record.⏎In their attempts to gather evidence for evolution, evolutionists have unwittingly proven by their own efforts that evolution cannot have happened at all!⏎The person who originally put forward the
-
term human-computer interaction (HCI) implies. Computers today are no longer just tools that respond passively to directions but social agents that are online participants in their own right. Miller notes that if I hit my thumb with a hammer I blame myself
-
ule or what the circumstances, will be punished severely.⏎Zero tolerance didn't work for the drug war; the Customs program championed by Meese choked on its own absurdities, finally dying a quiet death after Customs agents attempted to seize a scientific
-
can be seen as being exploited⏎What is a narrative therapy?⏎Narrative therapy is a style of therapy that helps people become—and embrace being—an expert in their own lives In narrative therapy, there is an emphasis on the stories we develop and carry
-
models -- my father grew up as an out-of-wedlock only child -- does not necessarily determine one's fate or destiny. Sometimes one must become one's own role model, a responsibility made easier by following this prescription, originally printed in my
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: you can find, for example, the number of ways to add two integers, which is a multiple, and it is possible to be in the range of the number, and there, the number is a multiple, and in the case,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
electrical activity within glia to send messages and information. It was therefore assumed that glia were deaf and dumb, incapable of communicating with either neurons or other glia, and therefore not particularly compelling as a focus of research. A good analogue would
-
In fact, some historians have argued the exact opposite: the Soviet Union only lasted as long as it did because the Kremlin held up a foreign enemy to distract from internal pressures. Without a boogeyman to act as a unifying force paper
-
+ 1 = 2. We then get the answer 524 Can we simplify? Yes, that's possible. 524 = 512.⏎The answer is 214 + 314 =
-
other examples of patterns you could use:⏎- Three letters, special character, three numbers⏎- Three numbers, special character, three letters⏎- Take a word
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:1721 excites
- L14:1952 excites
- L10:2979 suppresses
- L12:2564 suppresses
- L13:2338 suppresses 'not' in 'if not' hedges
- L9:844 suppresses
- L14:2295 excites
- L9:3068 suppresses
- L12:2662 excites
- L12:2806 weakly suppresses
- L12:2230 weakly suppresses
- L14:2399 weakly excites
- L0:1565 weakly suppresses
- L9:1478 weakly suppresses
- L12:154 weakly suppresses
- L12:2739 weakly excites
- L12:671 weakly suppresses
- L11:585 weakly excites
- L10:2431 weakly excites
- L9:2320 weakly suppresses
- L0:2895 weakly excites
- L8:1451 weakly excites
- L11:1548 weakly excites
- L0:2672 weakly excites
Feeds later layers
- L17:1485 strongly excites
- L17:2572 excites
- L19:3014 excites
- L25:849 excites
- L22:643 excites
- L27:1381 excites
- L16:1921 excites
- L18:2772 excites
- L27:983 excites
- L18:2632 excites
- L17:1359 excites
- L25:2669 excites
- L18:1882 excites
- L18:1026 excites
- L19:1630 excites
- L18:2471 weakly excites
- L17:2975 weakly excites
- L20:2483 weakly suppresses
- L20:1833 weakly excites
- L22:2796 weakly excites
- L21:1316 weakly suppresses
- L16:1833 weakly excites 'who' after a name and title
- L20:2976 weakly suppresses
- L17:2240 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- itself
- themselves
- herself
- oneself
- 自己
- 自身
- himself
- 自己的
- ourselves
- 了自己的
Suppresses
- ales
- ICIENT
- ��
- panse
- Priority
- opolitan
- ensen
- owitz
- continuous
- liberal