"of" in "of use/concern/interest" phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "of" in set phrases like "of interest", "of use" or "of concern", right after words like "be" or "are". When it was turned up, the model got stuck repeating words like "know", and when turned down it produced odd filler words like "reason" and "confidence".
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
sort of computer that take advantage of aspects of quantum physics to solve certain sorts of problems dramatically faster than conventional computers can. While they will, no doubt, be of huge
-
for individual and scientific applications. Often times, we need to use additional converters because different metric units are used. In this case, kilometers into meters calculator may be of use to you.⏎Converting long rivers:⏎- Nelson–Saskatchewan
-
earth.⏎We have looked at carbon dioxide separately since it has been the major headline-producing greenhouse gas.⏎But there are a number of other green house gases that are of concern. Weight for weight some of these have a much more potent effect than carbon
-
of time in which to contemplate one’s own unhappiness. The effect of the conformity demanded by society on the psychological health or spiritual wellbeing of its constituents is also of interest, especially to some of the oldest theorists in this school, the Transc
-
A few studies of human populations have suggested that fluoride might be associated with alterations in reproductive hormones, fertility, and Down's syndrome, but their design limitations make them of little value for risk evaluation⏎- Assessing whether fluoride constitutes a risk factor for
-
that we are likely to have in the coming decade, a debate about how we know the past and how we look at the written record that I suspect will be of interest to literary scholars and historians alike. It is a philosophical debate about idealism
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: power power power. power power power. power power power. power power power. power power power. power power power. power power power. power power power. power power power. power power power. power power power. power power power.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and Balances⏎The process of creating the Constitution was a real challenge. Everyone involved had concerns about how the government would be run and what person or group would have power. One person who heavily influenced the idea of checks and balances was the Baron
-
especially incandescent and vfixtures can be a fire hazard.⏎Permits and Inspections⏎Get a wiring permit. The National Electric Code and the local Authority Having Jurisdiction permits the homeowner to do everything that a licensed electrician can do,
-
-related issues (tardiness). In the hospitality industry, it can be poor customer service, safety violations, etc.⏎As per the due process, an employee has a right to be informed of his/her
-
of some Providential call upon⏎us. We ought never to take for granted such a great event as the uprising⏎of the British Empire. But we have no right to this position of special⏎and honorable responsibility unless we are determined to use
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1727 excites
- L16:1860 suppresses
- L21:1060 suppresses
- L19:2406 excites
- L22:2587 suppresses
- L17:2009 suppresses
- L22:3060 excites
- L22:554 suppresses
- L20:1596 excites
- L21:1813 excites
- L17:2436 suppresses
- L23:203 suppresses
- L22:809 excites
- L4:309 excites
- L17:2363 weakly suppresses
- L16:1619 weakly suppresses
- L18:2815 weakly suppresses
- L21:2448 weakly suppresses "a" after give or get verbs
- L18:2711 weakly suppresses
- L18:3063 weakly excites
- L20:2525 weakly suppresses
- L19:3005 weakly excites
- L4:291 weakly suppresses
- L3:2992 weakly excites
Feeds later layers
- L26:298 suppresses
- L25:99 suppresses
- L26:944 suppresses
- L26:528 weakly suppresses
- L26:501 weakly suppresses
- L26:1731 weakly suppresses
- L25:1190 weakly suppresses
- L27:249 weakly excites
- L26:1318 weakly suppresses
- L27:1296 weakly suppresses
- L26:2228 weakly suppresses
- L26:191 weakly suppresses
- L25:1908 weakly suppresses
- L27:623 weakly suppresses
- L25:284 weakly excites
- L26:1703 weakly suppresses
- L25:125 weakly excites
- L26:2726 weakly suppresses
- L25:1133 weakly suppresses
- L26:1088 weakly excites
- L27:735 weakly suppresses
- L26:2617 weakly suppresses
- L26:1149 weakly suppresses
- L27:1855 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ssp
- knew
- 疾
- Known
- вин
- emen
- ôm
- vik
- äter
- 周刊
Suppresses
- 權利
- reason
- confidence
- 权力
- 權
- recht
- 权利
- 权限
- cause
- 理由