full stops ending sentences
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the full stop at the end of a sentence in plain informational writing, such as health, science or how-to text. When it was turned up, the model's text wandered into different subjects and did not show a clear pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
as difficult to understand. This is compounded by the use of complex definitions and terminology. These complex definitions result from a need to categorise kidney diseases according to the way
-
be used to add visual interest to an outfit. When choosing patterns, it is important to consider their scale and how they will work with other elements of your outfit. You can also mix and match patterns for a more eclectic look, but it is
-
chances of winning. These scams are based on a misunderstanding of probability and random number generation.⏎In some countries, governments regulate and oversee the operation of lotteries. Some governments outlaw the practice altogether, while others endorse it to some extent and organize
-
are often separated from their parents for long periods of time. This can make the bonding process more difficult. Finding ways to help parents and these infants bond better is important for everyone in the
-
and break it down into small logical sections. No hydrochloric acid needed! If you still find it daunting, why not
-
platform they are targeting, be it iOS or Android, and adapt their coding practices accordingly. They face the challenge of optimizing app performance, ensuring compatibility across multiple devices, and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: this This This This This This This This This This This This This This This This This This This This This This This This
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
amps⏎On June 26, 1934, President Franklin D. Roosevelt signed the National Firearms Act of 1934 into law. The act placed a tax on the manufacture and transfer of certain firearms, with new
-
BY-SA 4.0<|endoftext|>Announcing the Aerial Expedition⏎We are proud to announce The Ocean Cleanup’s next major research mission: the Aerial Expedition. In September and October 2016, we will conduct a series of
-
this passage and the surrounding text, the only plausible interpretation of the harm principle is as follows: An individual may do as he pleases, as long as he does not believe that he is causing harm to others. That is Mill’s prescription for
-
do this are controlled by special neuron bundles in the spinal cord. It is not quite clear how these central pattern generators know how quickly the legs are to be moved.⏎An international team working with scientists from Harvard University and the Max Planck Institute of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:690 suppresses
- L16:2512 suppresses
- L17:503 excites
- L16:857 excites
- L10:478 suppresses
- L15:1861 excites
- L15:2841 excites
- L14:855 suppresses
- L13:300 suppresses
- L16:943 excites
- L17:1948 suppresses
- L15:1446 excites
- L2:902 suppresses
- L15:102 excites
- L17:1394 excites
- L17:417 suppresses
- L5:1653 weakly excites
- L12:808 weakly suppresses
- L13:997 weakly suppresses
- L13:659 weakly suppresses
- L14:1591 weakly excites
- L15:503 weakly suppresses
- L13:883 weakly suppresses
- L15:813 weakly excites
Feeds later layers
- L21:492 suppresses
- L19:1646 suppresses
- L19:1124 suppresses
- L20:42 weakly excites
- L19:1638 weakly excites
- L19:2627 weakly excites
- L19:1557 weakly suppresses
- L24:803 weakly suppresses
- L27:498 weakly suppresses
- L22:2557 weakly suppresses
- L26:405 weakly suppresses
- L23:459 weakly excites
- L20:101 weakly suppresses
- L19:1914 weakly suppresses
- L27:528 weakly suppresses
- L19:3064 weakly excites
- L20:1087 weakly excites
- L20:2718 weakly suppresses
- L27:59 weakly excites full stops in running text
- L19:1597 weakly excites
- L19:1546 weakly suppresses
- L19:1732 weakly excites
- L19:1046 weakly excites
- L19:1673 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- "]->
- 国外
- 出国
- ","\
- RID
- ".⏎⏎⏎⏎
- 国の
- ):\
- international
- 콩
Suppresses
- 这一
- this
- �权
- 这么大
- such
- 如此
- Such
- ifications
- 此类
- 这一点