"of" after an abstract noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "of" when it follows a noun like "style", "mode", "month" or "areas" and leads into a phrase such as "of life" or "of existence". Turning it up did not produce a clear, consistent change in the text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
] habituel (le)⏎→ Mrs. Robinson had assumed her normal place, whistle clamped between her teeth.⏎→ They are away from their normal place of employment, on a training course.⏎at the normal time à l'heure habit
-
singular manner: they practice circumcision, persevere in the observance of those customs which are enjoined by the law, and are so Judaic in their style of life, that they even adore Jerusalem as if it were the house of God."
-
he does.⏎The Sixth Month and Upward⏎By their sixth month of life, most kittens would have had the temporary teeth replaced by the adult teeth.
-
my class even let me play on their teams as the only girl during our sports classes until eighth grade (after that we were separated by gender and explored different fields of athletics). Soccer was the game shown on TV in restaurants and pubs. And I
-
against illegal discrimination, negative treatment and harassment based on their membership in these groups. These protections are designed to ensure equal opportunities and fair treatment in employment and other areas of life.⏎The protected classes of individuals in California labor law typically include the following:⏎
-
first of all that culture is a superstructure⏎thatrests upon a material basis.⏎The ideas, institutions and all cultural patterns are dependent on the material mode of existence of a society. These⏎change as all societies are subject to⏎change
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The first time, we are given a 100000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to lend and how much interest to charge. By not knowing their credit score, people risk paying more interest when they take out a loan and may face limits on the amount they can borrow. In extreme circumstances, they may find themselves “locked out
-
of breath, fatigue, and swelling, and can help improve tolerance for exercise.⏎When and How Do I Take Monopril?Some general considerations for when and how to take the medication include:⏎- Monopril comes in tablet form. It
-
Education department officials say they will require all elementary schools to adopt a phonics-based reading program — a potentially seismic shift in how tens of thousands of public school students are taught to
-
A Declaration of Intent, not final<|endoftext|>How Often to Water Succulents⏎You have a beautiful succulent in your home, and you want to know how often to water them. There are some simple tips to follow, but be sure to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:2268 excites
- L12:2176 excites 'of' after a place or role noun
- L16:2517 suppresses
- L17:1225 suppresses
- L17:1163 excites
- L18:1884 suppresses
- L12:2375 suppresses
- L11:429 suppresses
- L17:546 excites
- L15:1344 suppresses
- L9:731 suppresses
- L18:2086 excites
- L12:812 suppresses
- L18:2296 excites
- L18:1428 excites
- L16:1115 suppresses
- L8:500 suppresses 'to' after verbs like continue or help
- L6:2747 suppresses
- L17:2803 suppresses
- L18:3003 excites
- L15:2342 suppresses
- L14:526 excites
- L8:2529 weakly excites
- L9:2583 weakly excites
Feeds later layers
- L21:656 excites
- L21:215 suppresses
- L27:612 excites
- L20:1867 excites
- L24:762 excites
- L20:233 suppresses
- L20:1248 excites
- L20:330 excites
- L22:1226 excites
- L20:1006 excites
- L20:1327 excites
- L22:280 suppresses
- L24:480 excites
- L22:667 excites
- L26:346 excites
- L20:1913 excites
- L21:535 excites
- L22:1549 excites
- L23:781 excites
- L20:332 weakly excites
- L21:368 weakly excites
- L22:587 weakly excites
- L25:1357 weakly excites
- L20:421 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 运作
- 运行
- consumption
- 做事
- 行动
- działania
- operation
- operation
- action
- 访问
Suppresses
- (CultureInfo
- ensors
- ynchronously
- icides
- VERIFY
- behalf
- stamina
- aturas
- -FIRST
- AINER