second word of 'Centers for Disease'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the middle word of a name that is already half written, most often 'Disease' in 'Centers for Disease Control'. It seems to help the model finish a known name. When it was turned up, the written text did not show any clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
World War (1917-1918), the Second World War (1941-45), and events such as the Cuban Missile Crisis (1963).⏎During the Seminole Wars, the Spanish
-
number of connected in a tiny lobule. A minor salivary gland<|endoftext|>Applying Epidemiology To Program Design For Chronic Disease⏎According to the Centers for Disease Control and Prevention, 6 of the top 7 causes of death in the
-
osis. Supplemental vitamin D is popular because it is difficult (if not impossible) to get enough from food. In addition, as noted by the Centers for Disease Control and Prevention (CDC), our bodies
-
are more vulnerable to the Hepatitis C virus.⏎No vaccine is available for Hepatitis C, however it is curable with short term treatment.⏎The Centers for Disease Control and Prevention partners with community health organizations to help contain the infection. The AP
-
% quit rate." These statements are contrary to findings from two recent independent studies. But try telling that to U.S. health officials.⏎According to the Centers for Disease Control (CDC), the ALA's N-O-T program is the only smoking
-
as cases of COVID-19 continue to spike, you may be wondering when to get vaccinated against both viruses.⏎The answer is: Now.⏎The Centers for Disease Control (CDC) urges you--and anyone from six months of age or older
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately, and I have been thinking about lately. So, this is the part of the whole. Okay, so, I am a part of the whole. So, this is the part of the whole. Okay
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
who cared?)⏎So the sample results can be matched to the individual. Wired up to the internet the results can be fed in real time to the appropriate medical practitioner
-
1890. After appearance of troops at Pine Ridge, he advocated for peace with the European Americans⏎Date de dernière mise à jour
-
.org.uk/10.1177%2F1359104505053754<|endoftext|>From Sioux Falls to Rapid City, fire weather meteorologists are watching conditions closely. And until we
-
range. By early spring, when most of the range and the crests of the adjacent San Gabriel range have lost their kiss of snow, big San Gorgonio often still shines white—the one true jewel
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:50 strongly suppresses
- L3:691 suppresses
- L3:456 excites
- L2:41 excites
- L3:59 suppresses
- L3:464 suppresses
- L3:272 suppresses
- L3:421 excites
- L2:1710 excites
- L3:2140 excites
- L2:111 excites
- L3:115 excites
- L3:187 suppresses
- L0:1224 excites
- L0:178 excites
- L3:122 suppresses
- L0:1301 excites
- L2:2328 excites
- L2:2692 suppresses
- L2:1657 suppresses
- L2:1899 suppresses
- L2:70 suppresses
- L2:1036 suppresses
- L2:356 suppresses
Feeds later layers
- L8:1 weakly suppresses
- L27:2326 weakly excites
- L27:1995 weakly excites
- L27:1665 weakly excites
- L27:1974 weakly excites
- L27:2211 weakly excites
- L27:2116 weakly excites unclear: first and boundary tokens
- L27:107 weakly excites
- L10:0 weakly suppresses
- L27:1371 weakly excites
- L5:36 weakly excites
- L6:116 weakly suppresses
- L5:72 weakly excites
- L25:5 weakly suppresses
- L27:194 weakly excites
- L27:549 weakly excites
- L27:259 weakly excites
- L16:125 weakly suppresses unclear: mid-word and mid-phrase fragments
- L26:1564 weakly excites
- L11:0 weakly suppresses
- L16:166 weakly suppresses
- L27:1490 weakly excites
- L16:186 weakly suppresses
- L26:120 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Packages
- Tet
- Emp
- Sheets
- Symbols
- Eternal
- Wrest
- ücken
- agrid
- Gew
Suppresses
- 自身的
- 本身就是
- 本身的
- 的基础
- yourself
- 本身
- 的话
- 的一
- license
- 一趟