'that', 'about' or 'of' after a verb or noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on small connecting words such as 'that', 'about' or 'of' right after a verb or noun, where a clause or topic is about to start, like 'warned of' or 'heard about'. Turning it up did not produce a clear, related change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. All rights reserved. URL:http://www.healthscout.com/template.asp?id=669525<|endoftext|>It is certain, in any case, that ignorance, allied with power, is the most ferocious enemy justice can have.⏎
-
see there are so many questions asked meanwhile and students are expected to answers them. Some students may face some problem while answering it , but we promise you that after reviewing our answer, you will gain the confidence to answers such questions.
-
about television. Radio manufacturers rightfully worried that if people started buying TVs en masse, why would anyone want a new radio?⏎As Albert Abramson explains in his book about the early history of TV, demonstrations of TV technology were explicitly banned from the
-
can only do some rough estimation."⏎The Czech Republic - like Central Europe as a whole - is in a far better position than countries further east. But officials warn of a dangerous paradox: because the number of registered cases is so low, people become
-
on CNC machines, we had to keep the geometry simple because complex shapes would greatly increase manufacturing costs," says WHOI Supervising Engineer Bob McCabe." Then we heard about FDM and its ability to produce polycarbonate or ABS parts with the strength
-
was a blow to United States pride and prestige," reported the Christian Science Monitor. Time magazine quipped that Project Vanguard should be renamed Project Rearguard, and jokes about the botched
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a new. I have a new. I have a new. I have a new. I have a new. I have a new. I have a new. I have a new. I have a new. I have a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
08, OR<|endoftext|>A Global Index of Sustainable Well-Being⏎Source: The New Economics Foundation⏎From the Executive Summary:⏎There is a growing global consensus that we need new measures of progress. It is critical that these measures clearly reflect what
-
of his articles.⏎This narrow view drives some of those who cast a suspicious glance at the writer living outside of his country to end up with the naïve idea that it must be hard for writers in exile to write about their home countries: it
-
legends point out to various periods between this interval. Of course, some people might have arrived later and others earlier, but it is generally accepted by the great public that the island was uninhabited before 300 BC,
-
is missing or abducted and there is reason to⏎believe the child is in imminent danger, and there is information⏎available to disseminate to the general public that could assist in the⏎safe recovery of the child and/or the apprehension of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:651 suppresses
- L2:1336 excites
- L2:995 weakly excites
- L2:2505 weakly excites
- L2:406 weakly excites
- L1:1095 weakly suppresses
- L1:2568 weakly excites
- L2:683 weakly excites
- L1:436 weakly suppresses
- L2:41 weakly suppresses
- L1:1520 weakly excites
- L2:954 weakly excites
- L1:1137 weakly suppresses
- L1:227 weakly excites
- L0:1003 weakly suppresses
- L1:2306 weakly excites
- L2:618 weakly excites
- L2:1824 weakly excites
- L1:749 weakly excites
- L2:1095 weakly excites
- L1:2399 weakly suppresses
- L1:470 weakly excites
- L2:2043 weakly suppresses
- L0:2515 weakly suppresses
Feeds later layers
- L5:436 suppresses
- L4:223 suppresses
- L5:1949 suppresses
- L4:1349 weakly suppresses
- L19:1884 weakly excites
- L5:1043 weakly suppresses
- L14:1402 weakly excites
- L17:232 weakly suppresses
- L5:522 weakly excites
- L6:2450 weakly suppresses 'guess' and 'obvious' after 'as you can see'
- L5:165 weakly excites
- L5:724 weakly suppresses
- L5:1741 weakly excites
- L9:597 weakly suppresses
- L5:473 weakly suppresses
- L5:438 weakly suppresses
- L5:1297 weakly suppresses
- L7:1057 weakly suppresses
- L14:262 weakly suppresses
- L10:923 weakly excites
- L6:229 weakly suppresses
- L20:1510 weakly suppresses
- L12:2653 weakly excites
- L5:2133 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- erville
- trand
- pires
- .onStart
- ler
- uin
- aping
- thood
- .getService
- 嫌疑
Suppresses
- ikal
- ucken
- DEAL
- град
- 谩
- deal
- Aston
- MADE
- shake
- pictures