"of" after nouns like level or variety
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron wakes up on the word "of" when it follows a noun such as "level", "variety" or "mode", as in "level of production". It goes quiet, or slightly negative, on "of" in phrases like "think of". Turning it up made the text wander into unrelated topics rather than anything clearly tied to this word.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
at all, will simply do full inclusion of a new version, or byte-wise diffing, without any attempt to determine differences at a higher level.⏎- Variety of formats. There are literally hundreds of formats for graphical images. Although there are a
-
density of the uterus, the lining of the uterus⏎Severe stomach inflammation⏎Liver and kidney toxicity⏎Changes in the level of fats in blood and signs of liver⏎There’s A LOT of evidence out there
-
used to. Due to a decrease in both the level of physical activity you partake in daily and your resting metabolic rate, loss of appetite
-
not formalized at all?⏎Frequency: how often does the innovation take place: only once, sporadically, or is it permanent or regular?⏎Mode of Selection of Participants: is the innovation open to all participants, access is restricted to
-
particular product.⏎The company wants to raise it to 40%. In order to achieve this objective the marketer has to prepare a plan in respect of the level of production and promotion efforts. It will also be decided as to who will do what
-
ups fill in the visual details (such as colors, typography, etc.) and are usually static.⏎What is fidelity in design?⏎Design fidelity refers to the level of details and functionality built into a prototype. There are three levels of fidelity: low
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about it, and I have been thinking about it again. And I have been thinking about it again again again, and I have been thinking about it again again again again again again again again again again again again again again
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
24 hours.⏎3D printed valves⏎Once the Brescia hospital realised its regular valve supplier could not produce the valves on time, it was forced to think of alternative solutions as it had run out of breathing tubes for the intensive care machine.
-
found on beaches worldwide. When one thinks of the word recycling, it is newspapers, cardboard, glass, steel, aluminum foil
-
. If you aren’t familiar with UNIX, just think of a really complicated command language that the average person wouldn’t be able to figure out
-
the point of going as governess! What could he mean by such horrible indelicacy? To suffer her to engage herself — to suffer her even to think of such a measure!”⏎I find it interesting that at the moment of Austen
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L26:2899 weakly suppresses
- L20:1648 weakly suppresses
- L25:1769 weakly suppresses
- L19:2018 weakly suppresses
- L26:534 weakly suppresses
- L22:2750 weakly suppresses
- L27:2778 weakly suppresses
- L24:2858 weakly suppresses
- L23:2840 weakly suppresses
- L23:150 weakly excites
- L20:1292 weakly suppresses
- L17:213 weakly excites
- L5:961 weakly suppresses 'area' and 'volume' as measures
- L23:2548 weakly suppresses
- L25:1255 weakly suppresses
- L3:1578 weakly suppresses
- L24:19 weakly excites
- L27:2173 weakly suppresses
- L27:1629 weakly suppresses
- L21:2804 weakly suppresses
- L26:2588 weakly suppresses
- L13:3061 weakly suppresses
- L27:2449 weakly suppresses
- L11:372 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ele
- ption
- .throw
- ei
- eo
- ois
- throw
- оборот
- ersed
- сла
Suppresses
- 这个游戏
- ropolitan
- 此基础上
- aker
- 在游戏中
- akers
- ób
- nown
- ATAR
- 存量