'of' after a quantity or noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows a noun like 'one', 'all', 'women' or 'table', and a phrase like 'of' is expected next. When it was turned up, the model got stuck repeating the word 'of' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
for wandering astronauts, he adds, but there would be time to return to a shielded base.⏎To continue reading this article, subscribe to receive access to all of newscientist.com, including 20 years of archive content.<|endoftext|>Fly
-
by University of Minnesota students. You can see all of the details involved in making it in the video below.<|endoftext|>Create a Graph⏎Library Home || Full Table of Contents || Suggest a Link || Library Help⏎|National Center for Education Statistics
-
interviews conducted by researchers "blinded" to the status of the co-twin in an epidemiologic sample of 1030 female-female twin pairs of known zygosity from the population-based Virginia Twin
-
ernando Orthopaedic provides expert fracture care, with X-ray services available at our office. Contact us today to schedule an appointment.<|endoftext|>Welcome to the one of the most precious hidden jewels of Montenegro⏎First on this site more than
-
Achievement Gap⏎Each year more than 10,000 youth in Minnesota disengage from school, and Minnesota’s academic achievement gap has grown to one of the largest in the nation.⏎Have you considered leaving school? Are you currently dis
-
A few studies of human populations have suggested that fluoride might be associated with alterations in reproductive hormones, fertility, and Down's syndrome, but their design limitations make them of little value for risk evaluation⏎- Assessing whether fluoride constitutes a risk factor for
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: when I was a college student, I was in a life and death situation that involved many people. I was one person who had a life and death life, and I was helped by other people. But when I came to this life,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Eating Habits and Patterns⏎When you take a minute to think about what you’re eating, how you’re eating, and why you’re eating before you actually do it, your brain becomes
-
, drinking, and premarital sex, compared to people who do not have an account or seldom visits it.<|endoftext|>Nenana River Gorge
-
cheese with a string-like texture similar to mozzarella), mild to hot chilies, epazote (herb with a pungent flavor similar to a strong anise, fennel, or tarragon), sautéed
-
this emphasizes the importance of taking care of your physical and mental health through college and beyond.⏎Here are some pointers to get you on the right track.⏎If you do not work out much, college is a great time to form this habit as it
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2800 strongly excites
- L21:1718 strongly excites
- L21:460 strongly suppresses
- L19:2507 strongly suppresses
- L20:1356 strongly excites
- L21:2802 strongly excites 'of' inside set phrases like 'course of'
- L21:2966 strongly suppresses
- L21:2749 strongly suppresses
- L19:2622 strongly excites
- L20:2599 strongly suppresses
- L20:2860 strongly excites
- L21:2783 strongly excites
- L21:866 strongly suppresses
- L8:202 strongly suppresses
- L17:1771 strongly excites
- L20:1917 strongly excites
- L20:2949 suppresses
- L18:2467 suppresses
- L18:1954 suppresses
- L20:2962 suppresses "of" in "most X of all" superlatives
- L18:2808 excites
- L16:961 excites
- L18:759 excites
- L20:55 suppresses
Feeds later layers
- L26:711 strongly excites 'years' after an age number
- L23:567 strongly excites
- L27:447 strongly excites
- L25:2020 strongly excites
- L23:258 strongly excites
- L26:920 strongly excites
- L26:115 strongly suppresses
- L26:279 strongly suppresses
- L27:658 strongly excites
- L24:860 strongly excites
- L24:2753 suppresses
- L25:18 suppresses
- L23:2665 excites
- L25:2883 excites
- L24:1558 excites
- L26:309 suppresses
- L23:1014 weakly suppresses
- L26:1320 weakly excites
- L25:1206 weakly suppresses
- L27:1582 weakly suppresses
- L27:1905 weakly excites
- L26:54 weakly excites
- L24:2464 weakly suppresses
- L23:2087 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- of
- _of
- of
- Of
- Of
- →of
- của
- -of
- _Of
- _OF
Suppresses
- isel
- огда
- eci
- UNICATION
- 又被
- elia
- związ
- 就是一个
- çi
- 那就是