'of' in formal noun phrases, mixed
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' that follows a noun in formal writing, such as 'a substance of one density' or 'warranties of any kind'. It is pushed the other way by fixed phrases like 'Conflicts of Interest' and 'Seal of Approval'. The pattern is loose, and the steering text does not show a clear link.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
responsible for image formation by lenses and the eye.⏎- Optical density is the ability of a medium to refract light.⏎When a light ray passes from a substance of one density into a substance of different density, the speed of light changes and bending
-
of Oregon and Washington. Let's hope Cascadians welcome them back as the agents of ecological restoration that they are.⏎Posted by Eric de Place | Permalink<|endoftext|>This article is not intended to disparage the
-
intended to replace human translation. Neither BioOne nor the owners and publishers of the content make, and they explicitly disclaim, any express or implied representations or warranties of any kind, including, without limitation, representations and warranties as to the functionality of
-
up to 40,000 years. This is because the photons have to travel about twice the distance from the Earth to the Moon to<|endoftext|>Posted by Admin on August, 13, 2021⏎Every flame
-
. The adverb "yesterday" makes it clear that the action was in the past. The rules of grammar, which require the past tense of the verb plus the word "yesterday, make it redundantly clear that the
-
on some historic maps<|endoftext|>[File photo: DW]⏎A statue of Karl Marx designed by a Chinese artist was accepted on March 13 by the city council of Trier, a German town where the revolutionary socialist thinker was born. The statute
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the future of the human mind. What is the future of the human brain in terms of capability? and what is the future of the human brain in terms of capability? and what is the future of the human brain in terms of capability?
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
5i2.5⏎© 2018 Author. This work is licensed under the Creative Commons Attribution 4.0 International License.⏎Conflicts of Interest: None⏎Mild traumatic brain injury is defined as a traumatically
-
that solve the mathematical equations and algorithms which simulate the pollutant dispersion...⏎. To the general public, however, the AMS is best known for its "Seal of Approval" to television and radio meteorologists.⏎The AMS publishes nine atmospheric and related
-
- Custodial care: Personal care that's often given by family caregivers, nurses' aides, or home health workers who provide assistance with what are called "activities of daily living" such as bathing, eating, and dressing.⏎Long-term care is
-
cesis.⏎For Nietzsche, destiny keeps the form of Amor fati (Love of Fate) through the important element of Nietzsche's philosophy, the "will to power" (der Wille zur Macht), the basis of human behavior,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:1246 excites
- L9:2392 suppresses
- L8:608 excites
- L11:2016 excites
- L9:1026 suppresses
- L11:416 weakly suppresses
- L10:952 weakly excites
- L5:1392 weakly excites
- L10:132 weakly excites
- L8:1907 weakly suppresses
- L8:2722 weakly suppresses
- L8:1528 weakly suppresses
- L6:89 weakly suppresses
- L10:2105 weakly suppresses
- L6:460 weakly excites
- L0:3059 weakly suppresses
- L1:2623 weakly suppresses
- L6:2648 weakly excites "the" in nickname titles
- L8:1314 weakly excites
- L11:1392 weakly excites 'of' in fixed technical phrases
- L11:133 weakly suppresses
- L9:1633 weakly excites
- L5:2965 weakly excites
- L7:1684 weakly excites
Feeds later layers
- L14:1737 suppresses
- L16:2715 suppresses
- L14:677 excites
- L14:759 suppresses
- L15:646 suppresses
- L15:227 suppresses
- L13:1335 suppresses 'of' inside fixed noun phrases
- L17:870 suppresses
- L14:1265 suppresses
- L15:435 excites
- L14:491 excites
- L18:192 excites
- L16:434 suppresses
- L17:375 excites
- L13:1929 suppresses
- L13:1513 suppresses
- L19:2009 suppresses
- L13:364 excites
- L13:1181 suppresses 'of' after a definition or noun
- L15:42 suppresses
- L16:498 excites
- L13:2078 suppresses
- L13:416 suppresses
- L14:1082 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- anni
- cies
- ificantly
- 八个
- 应在
- しい
- 八十
- setParameter
- evacuate
- isphere
Suppresses
- agon
- ester
- าก
- entral
- emies
- вор
- oten
- máu
- .pol
- الذ