'Prevention' in the CDC name
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'Prevention' when it completes the name 'Centers for Disease Control and Prevention'. Turning it up or down did not produce anything clearly related to health.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
in a tiny lobule. A minor salivary gland<|endoftext|>Applying Epidemiology To Program Design For Chronic Disease⏎According to the Centers for Disease Control and Prevention, 6 of the top 7 causes of death in the United States are
-
11.7 million in 2007, or nearly 4% of the population, according to new figures from the Centers for Disease Control and Prevention (CDC).⏎That's up from about three million in 1971
-
temperature at the exact time they are checked, may fail to detect temperatures outside the recommended range.⏎The Centers for Disease Control and Prevention (CDC) published the Vaccine Storage & Handling Toolkit in January 201
-
page displays the U.S. government's seal of approval. Each declares that, "Initial funds for this web site were provided by the Centers for Disease Control and Prevention."⏎Visitors to the Not-On-Tobacco site, established in February
-
a prescription to save money.⏎- COVID-19 is exacting a significant toll on Americans' mental health to the point that the Centers for Disease Control and Prevention (CDC) has a dedicated webpage to stress and coping during the pandemic. When
-
to the age of 25 in 2006.⏎Researchers T.J. Mathews and Brady E. Hamilton of the Center for Disease Control and Prevention’s (CDC) National Center for Health Statistics, Division of Vital Statistics, Rep
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's a list of items. The list of items. The list of items. The list of items. The list of items. The list of items. The list of items. The list of items. The list of items. The
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1.⏎If you run this program, it will print the below output:⏎5 4 3 2 1⏎We need to use the range function to iterate over the array using a for loop. The range() function returns a
-
with <BODY> and end with </BODY>, but in practice this isn't essential. The HEAD
-
f(), and ldexpl() return ±HUGE_VAL, ±HUGE_VALF, and ±HUGE
-
multi-million line production code base" in question is the Dropbox code base, and maybe Dropbox has an idiomatic way of writing Python with lots of "isinstance()"s.⏎> In general, we believe that pattern matching has been proved to be
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:1437 weakly excites
- L2:2168 weakly suppresses
- L2:996 weakly suppresses
- L2:154 weakly suppresses
- L1:923 weakly suppresses
- L0:2369 weakly excites
- L2:1010 weakly suppresses
- L0:862 weakly suppresses
- L4:1400 weakly suppresses
- L3:171 weakly excites
- L2:2719 weakly suppresses
- L1:1040 weakly suppresses
- L0:552 weakly excites
- L2:41 weakly suppresses
- L0:2588 weakly excites
- L4:1788 weakly excites
- L4:526 weakly suppresses
- L3:2543 weakly excites
- L2:2952 weakly excites
- L1:1954 weakly excites
- L0:2405 weakly excites
- L4:1291 weakly suppresses second digit of years 20xx
- L2:483 weakly suppresses
- L4:2234 weakly suppresses
Feeds later layers
- L9:190 suppresses
- L19:2380 excites
- L22:1125 excites
- L14:784 weakly suppresses
- L10:73 weakly suppresses
- L6:1528 weakly suppresses
- L12:1856 weakly excites
- L25:1362 weakly excites
- L22:186 weakly suppresses
- L9:347 weakly suppresses
- L12:2900 weakly suppresses end-of-document boundary tokens
- L12:1475 weakly suppresses
- L15:911 weakly suppresses
- L15:296 weakly suppresses
- L10:1419 weakly suppresses
- L22:226 weakly suppresses
- L10:1455 weakly excites
- L27:638 weakly excites
- L16:579 weakly excites
- L8:1635 weakly suppresses
- L22:1541 weakly excites
- L15:2033 weakly excites
- L18:57 weakly suppresses
- L15:2854 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ressive
- ibe
- 但现在
- ())->
- =>"
- today
- iev
- soles
- science
- irus
Suppresses
- �
- areth
- 天然
- .lucene
- urf
- 涵
- airy
- ereco
- actic
- .amazonaws