words after 'list of' or 'number of'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is unclear and mixed. It tends to light up on the word right after a phrase like 'list of', 'number of' or '1000's of', where a noun or description is expected next. Turning it up did not produce a clear theme in the sample text.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
0a), and yet most biological movements involve a large number of degrees of freedom (in a rigid arm this number is directly related to the number and type of joints). An extreme case with especially high degrees of freedom is given by systems in which
-
scientist Dr. Robert Rose, the lead author of the study. “To that end, we sought out the top thought leaders in conservation and the remote sensing community to identify the best conservation applications of these data.”⏎“Collaborations such as these
-
may show some surprising uniformity in the way that micro-organisms are constructed, giving support for the lateral method of adaptation.<|endoftext|>||This article includes a list of references, but its sources remain unclear because it has insufficient inline citations. (May
-
that the client will prefer something over nothing. However, when the 406 Not Acceptable response is returned, the message body will contain a list of available representations that the client can choose from.⏎Search engines like Google will not index a
-
nature of that conflict.⏎The main memorial, just outside Stornoway, lists just over 1,500 names on 23 bronze plaques. It was erected in 1923, and inaugurated by the
-
of the beauty of Physics! With 10,000 words, 30 experiments and almost 100 cartoons and illustrations, ‘Fizzyx For Fun’
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a good friend. I have a good friend, and I have a good friend. I have a good friend. I have a good friend. I have a good friend, and I have a good friend. I have a good
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
from 0 to 9. We then place a 6 as the first "leaf" in that column. We repeat this process for each value in our dataset. In the end, we will get a stem-and-leaf plot like the
-
then be controlled by exposure to electrical current.⏎Semiconductors are the individual "on-off" switches that make up a electronic devices. By only allowing the conductance of electricity in specific situations (
-
-2018.Download⏎This study looked at the spatial and temporal patterns of lightning-ignited wildfires in Western Canada from 1981 to 2018. Studying patterns of lightning fires over
-
LEDs are all connected to the external cathode lead. To control each color, you need to apply a HIGH signal or VCC to the red, green, and blue leads and connect the anode lead to the negative terminal of the power supply
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1087 strongly suppresses
- L11:1764 suppresses
- L12:385 suppresses
- L12:626 suppresses
- L12:1738 suppresses
- L12:1431 excites
- L11:231 suppresses
- L12:2059 excites
- L11:1378 suppresses
- L9:956 excites
- L12:1507 suppresses
- L11:1409 excites
- L12:1991 excites
- L12:466 suppresses
- L11:98 suppresses
- L12:1879 excites
- L12:705 excites
- L10:2428 excites
- L8:276 suppresses
- L11:3030 suppresses
- L10:745 suppresses
- L12:1210 suppresses
- L12:1909 suppresses
- L6:415 excites
Feeds later layers
- L15:1107 strongly excites
- L14:1782 suppresses
- L17:2065 excites
- L19:592 suppresses
- L15:2998 excites
- L17:1436 suppresses
- L20:686 suppresses
- L17:1848 excites
- L14:1571 suppresses
- L14:1600 excites
- L16:2403 suppresses
- L19:1348 suppresses
- L14:2379 suppresses
- L14:1161 suppresses
- L16:581 suppresses
- L14:1324 excites
- L14:1820 excites
- L17:772 suppresses
- L14:636 excites
- L17:2845 excites
- L15:1920 excites
- L22:653 suppresses
- L15:2403 suppresses
- L14:2499 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- configs
- akah
- AppConfig
- 提案
- 读后
- çıkar
- 望着
- Idea
- -contained
- configs
Suppresses
- NSE
- leck
- WXYZ
- óż
- points
- .imwrite
- ISTRY
- Along
- osity
- isks