period ending a sentence that announces a list
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop at the end of a sentence that sets up what comes next, such as 'there are also several disadvantages to hard work.' It fits sentences that introduce a list or a set of points. Turned up, the model's text was unrelated and the steering results were mixed.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
hard work can often lead to greater mastery of skills, as repetition and practice can lead to improvement over time.⏎However, there are also several disadvantages to hard work. First, it can be time-consuming, leading to burnout and exhaustion. Second
-
options.⏎That said, in the past couple of years a number of factors have begun to crystallize in a way that may finally contribute to significant disruption and change. These include falling equipment costs; further innovation in materials;
-
sources. Additionally, AI writing assistants can also help improve your writing quality by suggesting improvements to your grammar and formatting.⏎AI has a number of other benefits as well. For example, AI can help you improve your search engine optimization (SEO) efforts
-
bite, and most of the time this dies down after a day or two without treatment. However, there are two potentially serious things that need to be ruled out. First, some insect bites can become infected. If this occurs, there may be
-
blood may result in bleeding more easily and nose bleeds.⏎More Serious Problems⏎Occasionally, frequent nose bleeds can be a symptom of a more serious problem. They may be an indication of some type of bleeding disorder, which could also cause
-
theory begins with cave paintings: In some cave paintings, it’s common to see creatures drawn with far too many limbs.⏎There are a couple of theories behind this. Some suggest that this was simply because the artists had no means of erasing the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's all the more more too, too, too, me too, too, too, Q, too, too,ito, Q, too, h, y,ito, y,ito, y,ito, y, y
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
<|endoftext|>The liver is an essential organ of our bodies, as it is responsible for producing glucose, breaking down carbohydrates, storing necessary nutrients, and detoxing the body. If a person has any
-
were neglected by the government of Assam and the federal authorities: the area had a single college; medical care was poor; infrastructure projects and job opportunities were few. In the nineteen-sixties, the Bodos
-
. It recognizes the broad determinants of health – income and poverty, education, environmental factors such as housing and transport – as well as health care and genetic influences. The Society aims to promote the development of scientific knowledge in social medicine. This covers
-
.seai.ie<|endoftext|>The peak signal-to-noise ratio (PSNR) is the ratio between a signal's maximum power and the power of the signal's noise. Engineers commonly use the PSNR to measure the quality of reconstructed images that have been
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:132 excites period ending an opening topic sentence
- L15:2467 suppresses
- L16:1733 suppresses
- L6:250 excites
- L17:2184 excites
- L16:2008 suppresses
- L13:263 excites
- L15:262 excites
- L1:337 weakly suppresses
- L10:251 weakly suppresses
- L15:945 weakly suppresses
- L16:2900 weakly excites
- L5:1653 weakly excites
- L14:900 weakly suppresses
- L13:2103 weakly excites
- L17:1490 weakly suppresses
- L14:489 weakly suppresses
- L16:1361 weakly excites
- L13:2937 weakly excites
- L14:1761 weakly suppresses
- L16:1145 weakly excites commas inside short lists
- L14:816 weakly suppresses
- L11:513 weakly excites words inside idioms and fixed phrases
- L17:1537 weakly suppresses
Feeds later layers
- L22:445 strongly suppresses
- L27:655 strongly suppresses
- L20:2564 suppresses
- L22:2150 suppresses
- L21:1587 suppresses
- L21:1424 suppresses
- L19:934 suppresses
- L25:637 suppresses
- L23:371 suppresses
- L20:1684 suppresses
- L21:2038 suppresses
- L25:2003 suppresses
- L19:2110 suppresses
- L20:2323 suppresses
- L20:2919 suppresses
- L26:2774 suppresses
- L22:1295 weakly suppresses 'as' before 'well' or 'as much'
- L19:3028 weakly suppresses
- L21:1973 weakly suppresses
- L19:2997 weakly suppresses
- L19:2597 weakly suppresses
- L20:1806 weakly excites slash inside web addresses
- L19:1593 weakly suppresses
- L26:124 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 불구하고
- erna
- };⏎
- }; ⏎
- };⏎
- нее
- }; ⏎
- }; ⏎ ⏎
- /il
- }';⏎
Suppresses
- also
- also
- Also
- Also
- 也
- también
- 也要
- 也为
- также
- 同时也