'of' after abstract nouns
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows an abstract noun like 'viability', 'role' or 'popularity', as in 'the role of'. It switches off, and even goes negative, on 'of' in names like 'Party of Michigan' or body parts like 'muscle of the heart'. Turning it up made the model's writing drift into long, wordy questions and problem statements, which doesn't clearly relate to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to ensure the viability of the element;⏎- R.4: The nomination describes wide participation of the communities
-
internal P load is a direct method, making it a valuable tool for lake management and restoration.⏎Laboratory incubations of sediment cores can help determine the relative importance of internal vs. external P loads, as well as be used to answer a variety
-
against a loss of bee diversity and abundance. Our results will contribute to understanding the mechanisms that determine the role of native biodiversity on crop pollination and provide key information to farmers and conservation managers in
-
several years with an increase in the popularity of aromatherapy. Natural essential oils stimulate our mind and body, promote circulation and
-
flight was made at Trout Lake, Wisconsin. Aviation pioneer and wealthy Chicago sportsman Logan “Jack” Vilas made the initial flight in order to demonstrate the viability of using aircraft in fire prevention. Wisconsin’s Chief Forester Edward Griffith hired him but
-
keeping missions, as the result of military service, or on humanitarian missions.⏎ACT Planning and Land Authority: The ACT Planning and Land Authority is responsible for the naming of public places in the ACT (nomenclature). Public places include districts, divisions
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been told by my mother, I have been told by my mother, I have been told by my mother, I have been told by my mother, I have been told by my mother, I have been told by my mother,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of the Socialist Party of Michigan were, in succession, cigarmaker Ben blumberg of Grand Rapids
-
, the outgoing National Executive Committee of the Socialist Party of America expelled the militantly Marxist Socialist Party of Michigan with its approximately 6.
-
the lower number indicating diastolic blood pressure.⏎• Systolic blood pressure represents the pressure exerted by the blood on the arteries when the muscle of the heart contracts and pumps blood through the blood vessels to the rest of the body
-
bronze statue embodies the “development of Marxism” and shows respect to the revolutionary philosopher.⏎“Marx has significantly promoted the development of human society. The Communist Party of China has adopted Marx’s ideas, developing Marxism and using it in real life ...
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:315 suppresses
- L4:1686 excites
- L4:4 suppresses
- L4:2711 suppresses
- L4:362 suppresses
- L3:537 weakly excites
- L0:1220 weakly suppresses
- L1:725 weakly suppresses "to" in "referred to"
- L3:1285 weakly suppresses
- L4:2347 weakly suppresses
- L3:315 weakly excites 'of' after a noun phrase
- L4:1151 weakly suppresses
- L1:632 weakly suppresses
- L2:895 weakly suppresses
- L3:1379 weakly excites
- L4:430 weakly excites
- L1:1041 weakly suppresses
- L0:2721 weakly excites
- L4:2801 weakly excites
- L1:3018 weakly excites
- L2:1321 weakly suppresses
- L2:927 weakly excites
- L3:74 weakly excites
- L2:2718 weakly suppresses
Feeds later layers
- L6:285 suppresses
- L15:477 weakly excites
- L18:1745 weakly suppresses
- L8:685 weakly suppresses
- L6:260 weakly suppresses
- L27:2356 weakly suppresses
- L9:1909 weakly excites
- L24:419 weakly excites
- L19:714 weakly suppresses
- L12:2853 weakly suppresses
- L12:459 weakly excites
- L10:1839 weakly suppresses
- L16:284 weakly excites
- L9:1299 weakly suppresses
- L17:2192 weakly suppresses
- L22:1239 weakly suppresses
- L13:1108 weakly suppresses
- L21:2547 weakly excites
- L6:153 weakly suppresses
- L13:2563 weakly suppresses
- L20:2805 weakly excites
- L19:713 weakly excites
- L14:534 weakly suppresses
- L16:2553 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 被执行
- coins
- 晶体
- coins
- ativos
- ünd
- rais
- $:
- CHED
- isci
Suppresses
- ersen
- ince
- uracy
- omore
- 让消费者
- erno
- kest
- er
- 人身
- quals