'of' in set noun phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Weakly fires on the word 'of' inside fixed phrases such as 'Seal of', 'Spirit of' or 'tincture of'. The signal is faint, and turning it up did not change the writing in a clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
slowly extinguished in a relentless march to annihilation. In exile, he would reflect on the lessons in a work that, today, ranks among the greatest works of the philosophy of war:⏎“Think, too, of the great part that is
-
UPF15 is considered good, with 50+ being the highest. Anything featuring UPF30 or higher receives the Skin Cancer Foundation’s Seal of Recommendation. (1)⏎But
-
. It’s the difference between sitting on your butt on the computer or watching TV and moving, just doing something, anything.)⏎- TEF-thermic effect of food. Basically the energy expended to digest and assimilate food into usable energy.⏎
-
And so sheep are easy to catch and there’s a lot of meat on them.”⏎We’ll hear more about the Australian Dingo in future programs.⏎Pulse of the Planet is presented with support provided by the National Science Foundation. I’m Jim
-
the symptoms of disease⏎tincture of iodine, iodine - a tincture consisting of a solution of iod
-
of an unelected, elite class of policymakers. Despite the reverence and appreciation local residents have maintained for the "Spirit of 1776," they now inhabit a world that was reshaped at
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first and the second and and the of the things, and the of the things. So, the first and the things are, and the of the things, and the things, and the things. So, are they? So,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
0 it gets 1st grade and is very good.⏎If the sheep gets<|endoftext|>|Republic of Latvia⏎|Anthem: Dievs, svētī Latviju!⏎God Bless Latvia!⏎and largest city⏎|Ethnic groups
-
is both an art and a science. It is an art because it requires patience and can be built with experience; it is a science because knowing the physics behinds and how they work, can greatly improve your proficiency. Fishing has both been a
-
Damage to three or more ligaments may cause joint dislocation.⏎The knee can be divided into three compartments: patellofemoral, medial and lateral compartment. The patellofemoral compartment is
-
forced him to leave Rome and work for King Alfonso of Naples (1452-1455), but he resumed his position as papal secretary after Nicholas V's death in 1455 and remained there for
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:249 excites
- L5:769 suppresses
- L2:328 excites 'of' in fixed names and phrases
- L5:1299 excites
- L2:1175 weakly suppresses
- L4:2807 weakly excites
- L6:136 weakly suppresses
- L4:673 weakly excites unclear: pieces of split words
- L0:109 weakly suppresses
- L2:2641 weakly excites
- L0:2549 weakly excites
- L3:1092 weakly suppresses
- L2:1788 weakly suppresses
- L2:772 weakly excites
- L2:943 weakly suppresses
- L1:2922 weakly excites
- L3:15 weakly excites
- L2:1510 weakly excites
- L6:775 weakly excites
- L4:512 weakly excites
- L3:801 weakly suppresses
- L0:264 weakly excites
- L5:2018 weakly excites
- L1:2606 weakly suppresses
Feeds later layers
- L9:61 suppresses
- L16:337 suppresses
- L9:324 suppresses
- L16:1590 suppresses
- L10:77 suppresses
- L9:119 suppresses
- L15:798 suppresses
- L11:604 suppresses
- L15:904 suppresses
- L10:37 excites
- L11:621 suppresses 'of' inside organization names
- L14:148 suppresses closing bracket after an acronym
- L10:709 suppresses
- L9:2286 suppresses
- L10:1218 excites
- L9:146 excites
- L8:349 suppresses 'of' inside title-like noun phrases
- L15:1554 suppresses
- L12:77 suppresses
- L16:1432 excites
- L15:638 suppresses "the" inside institution names
- L9:190 suppresses
- L15:1855 excites
- L15:2906 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ingly
- theless
- lessly
- ivating
- oba
- StatusBar
- alyze
- Ahead
- eker
- ivated
Suppresses
- given
- identical
- pen
- ctp
- ассив
- interests
- conjug
- .Assertions
- taken
- 两张