"of" after "kind" or "sort"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "of" in phrases like "some kind of" or "some sort of". Those phrases are the spot where the writer is about to name the type of something. Turning it up did not give a clear topic change in the samples.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, after Hawaii became a state the prior year."⏎From the Internet<|endoftext|>Fraud is a term that is used to describe deception perpetrated in order to achieve some kind of goal or benefit. Fraud can be either civil, criminal, or both, with
-
natural disaster in an attempt to help the people in the midst of crisis. Individual aid groups have also developed treatment programs for women and men who have suffered some kind of sexual abuse. However, mental healthcare in developing countries has never been taken on by
-
.⏎For example, let’s say a study tried to test the effects of violent game by having a participant play a game and then asking them to do some kind of word completion test. If the study found that people who played the violent game were
-
royalty (for other<|endoftext|>There is often an ordinary, unremarkable beginning to a life dependent on opioids. Someone might experience a routine surgery or have some kind of accident such as a fall or car crash. Following events like these, a
-
a few days, the CNT and the Socialist General Confederation of Workers (UGT), which since December 1933 had been discussing some kind of working-class alliance, planned a national general strike. It began on October 4
-
and also points to separate research which estimates that up to 22% of crashes could be caused by some kind of distraction; and drivers who perform a secondary task at the wheel, like using a
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about recently, and I have been thinking about recently. I have been thinking about recently. I have been thinking about recently. I have been thinking about recently. I have been thinking about recently. I have been thinking about
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a goodly portion of those who wished to live outside the city during their visit. It would
-
In addition to a few reminders of the Middle Ages, the upper town is best-known for its 16th-century Renaissance heritage. This was the most opulent of all periods in the town’s history from the political and cultural point of view
-
Electronic Privacy Information Center, 1992.⏎The American Inquisition: Federalism Gone Amok⏎Modern inquisitorial methodology has changed quite a lot since the time of the Spanish Inquisition<|endoftext|>Fire can incite awe, terror
-
or metal in an attempt to straighten their back.⏎Dr Lund said: "Scoliosis is a painful illness, and Richard would have been in quite a lot of pain on a daily basis.⏎"These methods could also
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:180 weakly excites
- L0:645 weakly excites
- L0:405 weakly suppresses
- L0:458 weakly excites
- L0:1028 weakly excites
- L0:1732 weakly suppresses
- L0:1805 weakly suppresses
- L0:1332 weakly suppresses
- L0:1730 weakly suppresses
- L0:437 weakly suppresses
- L0:2792 weakly suppresses middle pieces of split words
- L0:1228 weakly suppresses
- L0:753 weakly excites
- L0:1279 weakly excites
- L0:289 weakly suppresses
- L0:84 weakly suppresses
- L0:97 weakly excites
- L0:2868 weakly excites
- L0:2038 weakly suppresses
- L0:2394 weakly suppresses
- L0:2517 weakly suppresses
- L0:620 weakly excites
- L0:287 weakly suppresses
- L0:305 weakly excites
Feeds later layers
- L20:2575 weakly suppresses
- L14:2859 weakly excites
- L6:2475 weakly suppresses
- L17:1540 weakly suppresses
- L14:2917 weakly excites
- L23:747 weakly suppresses
- L7:116 weakly suppresses
- L20:2842 weakly excites
- L21:1344 weakly suppresses
- L11:2623 weakly suppresses
- L13:22 weakly suppresses
- L18:1709 weakly excites
- L4:2061 weakly excites
- L25:1097 weakly excites 'the' or 'of' after a role or title
- L14:1438 weakly suppresses
- L13:3000 weakly suppresses
- L23:2150 weakly suppresses
- L4:1873 weakly excites
- L2:87 weakly suppresses
- L5:3009 weakly suppresses 'to' after a verb or noun
- L11:2937 weakly excites
- L11:1078 weakly suppresses
- L20:1156 weakly suppresses
- L3:1550 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- vant
- 률
- rement
- 蛙
- あります
- 问道
- |r
- Wonderland
- na
- ROUND
Suppresses
- 同样
- CharCode
- bury
- .setFill
- itos
- 了一口
- LoginPage
- arsen
- 当事
- ős