'of' after a group noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "of" when it follows a word for a group, like "groups of", "teams of", "packs of" or "sets of", where a list of members is about to come. When it was turned up, the model's writing drifted toward vague, wordy talk about people and groups, though the effect was not very clear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Teachers of Mathematics.⏎merical values and use it when x=3 (with success rates of 69% and 81% for the two groups of students, respectively). They were less successful, however, when asked to derive from
-
ative algebra, with the language and the problems of geometry.⏎The main objects of study in algebraic geometry are algebraic varieties, which are geometric manifestations of sets of solutions of systems of polynomial equations. Examples of the most studied classes of algebraic
-
classes serve as a legal cornerstone that prohibits discrimination in various aspects of life, particularly within the workplace.⏎Protected classes, in a legal context, refer to groups or individuals who are safeguarded by specific anti-discrimination laws, ensuring they are
-
fellows and who get on in life, and the men who recruit the aristocracy and who doubtless largely form the plutocracy. It is significant that the group of low-class men—artisans and peasants—and the men of religion, whose mission
-
usually smaller. They are generally about 5-7 feet long from nose to tail (the tail is usually about 2 feet long) and move in packs of up to 15 members! To learn more about gray wolves, you can
-
blindness. Two teams of scientists have used modified viruses injected into the eye to partially restore vision to people suffering
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been working on the first two of the three different ways I have seen the first two of the three different ways I have seen the first two of the three different ways... the first two of the three different ways I have seen the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a podiatrist, and local podiatric societies and insurance companies may have directories of practitioners. Podiatrists are also listed in the yellow pages of your phone book. The State Board for Podiatry cannot refer you to a practitioner.⏎If
-
answer this question⏎Join a community of thousands of dedicated teachers and students.Join eNotes<|endoftext|>Is there something else you would like to know?⏎Use the alphabetical glossary listing to find a short definition to a medical or dental term. If you would
-
Named GLIMPSE360 (Galactic Legacy Mid-Plane Survey Extraordinaire project), the deep infrared survey captures only about 3% of the sky, but because it focuses on the plane of the Milky Way, where stars are
-
structive Sleep Apnea is a serious and potentially life-threatening sleep disorder in which blockage of the airway during sleep occurs. The muscles in the upper airway collapse, which interferes with proper breathing. The most noticeable
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:1069 strongly excites
- L14:1823 suppresses
- L10:1318 excites
- L9:747 excites
- L11:1941 suppresses
- L6:511 excites
- L12:1191 excites
- L9:310 excites
- L12:1227 excites
- L4:2159 suppresses
- L12:1941 suppresses
- L5:1471 excites
- L13:2788 suppresses
- L14:1782 excites
- L12:957 excites
- L9:910 suppresses
- L13:2496 excites
- L10:1100 suppresses
- L12:1241 suppresses
- L9:504 suppresses
- L8:532 excites
- L15:2615 excites
- L10:1841 excites
- L4:920 excites
Feeds later layers
- L18:1098 excites
- L17:1246 excites
- L17:1157 excites
- L17:1390 suppresses
- L20:965 excites
- L18:968 excites
- L22:874 excites
- L18:919 excites
- L19:2473 excites
- L17:1535 suppresses
- L24:1547 weakly excites
- L27:2478 weakly excites
- L18:2429 weakly excites
- L17:2139 weakly excites
- L21:2373 weakly excites
- L24:361 weakly suppresses
- L23:1437 weakly excites
- L18:456 weakly suppresses
- L18:2621 weakly excites
- L18:1654 weakly suppresses
- L17:1274 weakly excites
- L26:1549 weakly excites
- L23:572 weakly excites
- L17:1873 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 里的
- 成员
- 里
- containing
- members
- members
- 裡
- 中新
- 中的
- Members
Suppresses
- اته
- 程
- iento
- _unicode
- _CLICKED
- rito
- PropertyChanged
- еле
- reads
- 旒