"of" after a noun in "X of Y"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "of" when it joins a noun to what follows, as in "course of action", "speed of the computer" or "frame of the car". When it was turned up, the model drifted into repeated filler words like "the process of the human life".
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
been no previous indication that Chloroquine has been harmful to pregnant woman.⏎I think that it is important to emphasize that patient panic does not lead to a run of finding this medication on the internet. This drug should be targeted for prevention to high
-
of pus⏎- Tiny red spots on the area at the back of the roof of the mouth (soft or hard palate)⏎- Swollen, tender lymph nodes in
-
positive or negative.<|endoftext|>Think of your body like a car. Where the muscles are the shock systems and the skeleton (joints/bones) is the frame of the car. The job of the shock system is to absorb any force that is
-
the image, the speed of the computer, the number files, and the size and resolution of the selected window
-
about virtuous living by thinking over the qualities of each virtue. 2. Meditation can help a child learn to think for themselves, and determine a best course of action by reflecting on possible solutions. 3. If the child is being raised
-
feel even worse than before as the infection takes hold.⏎Once you know what is causing your symptoms, you can talk to a pharmacist or doctor about the best course of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: #10000000000000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and philosophical principles, this is a thorough exploration of the concept and practice of⏎liberalism.ABOUT THE SERIES: The Very Short Introductions series from Oxford University Press contains hundreds of titles in almost every subject area. These pocket-sized
-
grass-eating ox.⏎Has a nation ever exchanged its gods?(But they were not gods!)Yet My people have exchanged their Gloryfor useless idols.⏎“Tarshish was your trading partner because of your great wealth of every kind. They exchanged
-
“Civil Rights Act” of 1964. The whole world watched in awe and amazement as Neil Armstrong became the first human being to ever set foot on the moon. The
-
the input-output pair. It is called supervised learning because the process of an algorithm learning from the training dataset can be thought of as a teacher
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:785 suppresses 'of' in set phrases like 'of course'
- L6:357 suppresses
- L10:469 suppresses 'of' after a noun phrase
- L5:363 excites
- L17:317 excites 'of' after a noun phrase
- L16:1088 excites 'of' after a noun phrase, as in 'of course'
- L19:715 excites
- L3:315 excites 'of' after a noun phrase
- L7:8 excites
- L0:40 suppresses 'of' in 'sort of' hedges
- L4:4 suppresses
- L8:1003 suppresses "the" or "of" before a noun phrase
- L4:1686 excites
- L4:16 weakly excites
- L17:264 weakly suppresses
- L0:2726 weakly excites
- L6:388 weakly excites
- L14:348 weakly suppresses
- L3:1379 weakly excites
- L13:1515 weakly excites "your" before doctor or health provider
- L2:87 weakly excites
- L0:1220 weakly suppresses
- L6:2956 weakly suppresses
- L16:41 weakly suppresses
Feeds later layers
- L26:2490 suppresses
- L26:1374 suppresses
- L26:1179 weakly suppresses
- L26:281 weakly suppresses
- L23:474 weakly excites
- L23:2441 weakly suppresses
- L27:325 weakly suppresses
- L26:1776 weakly suppresses
- L26:693 weakly excites
- L26:548 weakly excites
- L26:800 weakly suppresses
- L25:642 weakly excites
- L27:2948 weakly suppresses
- L26:193 weakly suppresses
- L26:377 weakly suppresses 'sh' starting a word piece
- L23:619 weakly suppresses
- L26:2178 weakly suppresses the letter 'l' inside words
- L24:3008 weakly suppresses
- L27:744 weakly suppresses
- L26:402 weakly suppresses
- L26:1545 weakly suppresses
- L23:2833 weakly suppresses
- L26:1542 weakly excites
- L25:36 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 她的
- igan
- hỏi
- lie
- naissance
- 原文地址
- reich
- xfc
- 鲜血
- thern
Suppresses
- odka
- 器
- ers
- mẽ
- oretical
- ожет
- ute
- ive
- theless
- LETE