comma after an introductory phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires at the point right after an opening phrase such as "Aside from the standard testing" or "While doctors treat illnesses", just before the main clause starts. The steering results did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
for making special components.⏎Tips and Warnings⏎Don’t try using a lathe unless you know exactly what you’re doing. Aside from the precautions mentioned earlier you should always roll the sleeves above the elbows.⏎Stop the lathe before adjusting any
-
iromancy, however, is kind of vague, with each ancient culture offering different variations in dream interpretation. And aside from the dream meanings advocated by our ancestors, some great psychoanalysts have also offered
-
ological properties, differences in the relative mechanical properties can be determined during the acquisition of an image and subsequently used as an indirect chemical probe. Beyond analysis under ambient conditions, atomic force microscopes can easily be outfitted for detailed relative humidity and reactive gas
-
and other toxic substances build up in the blood, causing life-threatening complications shortly after birth.⏎While infants with citrullinemia type I appear normal at birth, within the first week of life, most will become lethargic and display poor
-
public health is the impact it can make. Public health is community health. Medicine is to the individual as public health is to the population. While doctors treat illnesses, public health professionals implement health promotion and health education.⏎Unlike medicine, there is no
-
saying.⏎Interestingly, I’ve been able to hold space more on the professional level while practicing optometry for 20 years. Aside from the standard clinical testing, I would sit and give my patients my full attention. I was always struck
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: When you have a problem to be solved, it is not only as the problem can be proved to be false or true or to be (as well as the rest of this) and then it is not a problem to be proved to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
> <H1>This is the Page Heading</H1> This is the first paragraph. <P> This is another paragraph, with
-
and captured by the U.S. Army 2nd Division in Korea, during the Korean War. A convoy of jeeps and trucks on the road. The trucks are loaded with supplies and soldiers. Soldiers on trucks unload rations,
-
one put a price on historic culture?”⏎While the answer seems obvious, the reality from a fiscal viewpoint is that this rare community treasure does not sustain itself financially.⏎From The Start⏎The original Rancho site was 27,
-
designed to provide cosmetic chemists and formulators with ideas and advice to solve formulating challenges. To submit a question, e-mail FormulateThis@allured.com.⏎Question: I’m trying to understand cosmetic emulsion inversion. What actually happens
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:71 excites
- L12:51 excites
- L11:2214 excites
- L11:567 excites
- L8:131 suppresses
- L12:2548 excites
- L6:1084 suppresses
- L12:959 weakly excites
- L12:1443 weakly suppresses opening parenthesis after a name or term
- L9:1458 weakly excites unclear: word completing a verb phrase
- L9:2181 weakly excites
- L8:70 weakly excites 'and' between stacked superlatives
- L12:2208 weakly excites
- L9:1374 weakly excites
- L10:1654 weakly suppresses opening parenthesis before an acronym
- L12:1254 weakly excites
- L9:283 weakly suppresses
- L11:1205 weakly suppresses
- L10:144 weakly suppresses
- L7:398 weakly suppresses
- L6:982 weakly excites
- L11:1116 weakly excites
- L8:1477 weakly excites
- L6:1652 weakly excites
Feeds later layers
- L15:1664 excites
- L15:252 weakly suppresses
- L14:2204 weakly suppresses
- L17:2269 weakly suppresses
- L17:2864 weakly suppresses
- L15:2114 weakly excites
- L15:220 weakly suppresses
- L19:1689 weakly excites
- L16:2665 weakly excites
- L16:520 weakly suppresses
- L20:2854 weakly excites 'official' and government institution words
- L15:36 weakly suppresses
- L16:1121 weakly suppresses
- L24:2998 weakly excites
- L20:1727 weakly excites
- L24:1361 weakly excites
- L18:1169 weakly suppresses
- L14:2616 weakly excites
- L14:578 weakly excites
- L27:38 weakly excites
- L16:2865 weakly suppresses
- L14:53 weakly excites
- L15:2628 weakly suppresses
- L23:748 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- star
- combat
- lesi
- oe
- Stars
- lt
- conds
- oi
- stars
- gear
Suppresses
- paring
- ışı
- -floating
- IFA
- ||(
- retrieval
- 这一点
- Went
- .IsDBNull
- ritten