pronouns referring back to a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to pronouns like "it," "one," "her" or "they" that point back to a thing or person mentioned earlier in the sentence. Its opposite side goes the other way, on he and they inside quoted speech. Turning it up didn't produce a clear theme in the sample text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
In some people, however, cells start to ignore insulin, which means the pancreas must manufacture more of it. Insulin resistance is ‘silent’ because often the pancreas can keep up
-
able error message is received, it is in response to an HTTP request that includes a negation-related header such as Accept or Accept-Language. When the client includes one or more of these headers, the server will satisfy the requirements if possible.⏎The
-
we will do everything in our power to earn the confidence,” says Sten Roald Lorentzen.⏎The progress plan is not<|endoftext|>As process nodes shrink, it’s become increasingly difficult for the major semiconductor foundries to offer compelling advantages at each
-
’t subjected to a long delay if a “cron job” happens to be running. Well almost…⏎Recently Dokuwiki gained an indexer to improve the performance of it’s search functionality. Dokuwiki doesn’t use a database – wiki pages are
-
and built a number of hiding places in the house and in the barn.⏎Galina and Yuri would bring food to Paulina each day. The family also provided her with clothing and false identity documents, should the farm be raided by the Germans.⏎
-
they’re treated:⏎Benign Paroxysmal Positional Vertigo (BPPV)⏎When someone has vertigo—a severe form of dizziness in which it feels like you or everything around
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have to be in the same group, and I have to be part of the group. The other group is also in the same group, but I have to be in the same group. So, the other group is in the same
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
or an underlying set of principles, or an underlying way of looking at the world so that then when the next Aristotle comes around?" Jobs said. "Maybe if he carries around one these machines with him his whole life and types in all this stuff
-
the tech,” Ratto told Fast Company in an interview. “In fact you can’t even differentiate, you can’t even separate the tech from the social. They are irretrievably interwoven together. And I think this is the biggest
-
.⏎"If they were to replace the batteries with these supercapacitors, you could charge your
-
song; he talks about being pro-choice in this song, he talks about being anti-street-harassment in this song. But he also — it's an autobiographical song about being a young black male growing up<|endoftext|>Despite progress,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:1064 excites
- L9:175 suppresses
- L7:1405 excites
- L6:84 excites
- L7:1809 suppresses
- L8:1825 suppresses
- L9:1907 excites
- L5:583 excites
- L2:803 excites
- L5:165 suppresses
- L7:1624 excites
- L7:616 excites
- L6:1458 suppresses
- L6:1135 weakly suppresses
- L4:1306 weakly excites
- L9:592 weakly suppresses
- L7:173 weakly excites
- L2:2195 weakly suppresses
- L8:40 weakly suppresses
- L6:1191 weakly suppresses
- L9:52 weakly suppresses
- L5:1664 weakly suppresses
- L6:98 weakly excites
- L6:153 weakly excites
Feeds later layers
- L14:1668 suppresses
- L11:1419 excites
- L11:2864 excites
- L19:685 suppresses
- L14:3063 excites
- L15:396 suppresses
- L16:1077 weakly excites
- L12:1653 weakly excites
- L17:354 weakly excites
- L12:978 weakly excites
- L14:1317 weakly excites
- L11:222 weakly excites
- L15:503 weakly excites
- L14:990 weakly excites
- L14:1849 weakly excites
- L14:3022 weakly suppresses
- L18:381 weakly excites
- L15:1544 weakly excites
- L14:778 weakly suppresses
- L12:2347 weakly excites
- L17:202 weakly suppresses
- L18:2324 weakly excites
- L15:2811 weakly excites
- L12:850 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- erves
- 个工作日
- erved
- ở
- den
- <header
- EXTERN
- _DIRECT
- 主持召开
- 服务能力
Suppresses
- mieux
- 不上
- 高低
- Karnataka
- jang
- loff
- ��
- ogne
- 但他们
- stair