'of' after an action noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on 'of' when it follows an action word turned into a noun, such as 'removal of', 'insertion of' or 'reactivation of'. The examples are mostly medical or procedural. Turning it up gave text that wandered off topic, so the steering does not clearly show this.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
allergy, the removal of the cause can be much more difficult.⏎There are some common triggers for hives
-
leads to a compromised immune system. Because the body’s natural defense mechanism is somehow decreased, then there is no adequate immunologic mechanism to check against the reactivation of the HSV-1. This leads to an eruption of cold so
-
the insertion of the catheter. Once the catheter has been inserted into the arteries, our
-
untreated caries often leads to inflammation of the tooth root. Root canal treatment can save the diseased tooth.⏎Root canal treatment with dentures Also, the insertion of a crown or dental bridge may precede a root canal. If the dentist has
-
as "quantum tunneling," this strange phenomenon had previously been thought to occur only on very small scales.⏎In this paper I report instances of the spontaneous relocation of entire cats. Though cats are arguably quantal to the extent that they tend to
-
reside in any part of Nigeria.⏎5) Section 143 of the 1999 constitution of Nigeria – This section harps on the removal of the president and vice-president from office.⏎6) Section 37 of the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of the way of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
He was elected to the most prestigious scientific academies of Europe. The rulers of both England and Denmark offered him large honorary pensions which he
-
wore a short mitre. This last saint was the virginal Apostle Saint John the Evangelist.⏎Our Lady of Fatima (1917)⏎As we discussed a few days about on
-
relatively harmless, but<|endoftext|>There are two well-known approved apparitions of Saint Joseph - but of which occurred in the context of a Marian apparition.⏎Our Lady of Knock (1879)⏎On the evening of Thursday, 21
-
J. (Robert John), 1801-1869⏎Articles of Agreement and Specifications, Topeka School House Construction⏎Authors: New England Em
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L1:562 weakly excites
- L5:1453 weakly suppresses
- L17:5 weakly excites
- L4:285 weakly suppresses
- L18:1575 weakly suppresses
- L9:2529 weakly suppresses
- L6:322 weakly excites
- L17:390 weakly suppresses
- L16:3005 weakly excites
- L2:312 weakly excites
- L5:2680 weakly excites
- L5:2960 weakly excites
- L14:365 weakly excites
- L2:302 weakly suppresses
- L15:280 weakly excites
- L17:759 weakly suppresses
- L13:1983 weakly excites
- L21:1590 weakly excites
- L21:772 weakly excites
- L19:274 weakly excites
- L20:2114 weakly excites
- L25:1118 weakly suppresses
- L10:1772 weakly suppresses
- L26:2283 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- apiro
- <nav
- าก
- ibly
- ationally
- ��
- NavigationItemSelectedListener
- ucks
- Levine
- なく
Suppresses
- 치
- 你就
- 当你
- ovi
- ']",
- Vo
- 我们一起
- itez
- 的东西
- Vo