middle of fixed names and phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires inside well-known fixed phrases and names, like 'too good to be true', 'Centers for Disease Control and Prevention' or 'National Aeronautics and Space Administration', where the next word is almost certain. The strongest examples are the middle words of these set phrases. Turning it up did not produce any clear theme in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ask a parent or adult before you fill out any forms, or give out money or credit card details.⏎- Don't accept any offers that seem too good to be true - they probably are.⏎Remember to always be
-
when you're online to keep your identity safe.⏎- Only Make Purchases On Trusted Sites⏎When deals seem too good to be true, they just may be - you might be paying as a victim of identity
-
GAO found that: (1) DOE plans to continue RTG assembly and testing at its Mound facility through the completion of the National Aeronautics and Space Administration
-
than usual and without the energy you normally have during the warm months to get things done.⏎Other symptoms of SAD include the following:⏎Often, overcoming seasonal affective disorder can be done at home. However, if you choose to not give S
-
eroding or shaping the landscape,” says Corbett.<|endoftext|>Seasat image of sea ice, 1978.⏎© National Aeronautics & Space Administration / Science & Society⏎This map was prepared using altimeter data from
-
laxatives. Some symptoms of anorexia nervosa are:⏎Loss of a period⏎Lightheadedness, dizziness
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the past is not fully due to the individual, and the ... well, this being proposed ... to the ... well-informed society, it is ... well-instructed ... by the ... well-known ... and the ... well-known ... and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
alopathy-PML. Updated January 8, 2016. Accessed September 26, 2016.⏎Progressive multifocal leukoencephalopathy (PML). AETC National Resource Center website
-
defense.⏎Then and now:⏎- View a streetscape panel displayed on Roybal campus showing the original and expanded areas of CDC’s campus.<|endoftext|>Woods Hole Oceanographic Institution (WHOI), renowned for its role in the discovery of the Titanic
-
, Action, Awareness⏎NORD—National Organization for Rare Disorders⏎Canadian AIDS Society⏎CORD—Canadian Organization for Rare Disorders⏎NINDS progressive multifocal leukoencephalopathy information page. National Institute of Neurological Disorders and Stroke
-
this spectacle, drawing on evidence gathered by NASA’s Galaxy Evolution Explorer and the Pan-STARRS1 telescope located in Hawaii. Here’s how NASA describes what you’re seeing
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:297 strongly excites
- L0:1548 excites
- L8:849 suppresses
- L3:607 excites
- L2:693 suppresses
- L3:1302 excites
- L2:1840 excites
- L5:67 excites
- L1:328 excites
- L0:245 excites
- L0:1902 excites
- L3:521 suppresses
- L1:48 excites
- L9:746 suppresses
- L6:2612 excites
- L4:335 suppresses
- L0:88 excites
- L9:845 excites
- L8:1183 excites
- L0:1141 excites
- L1:2511 excites
- L8:2388 suppresses
- L9:2153 excites
- L9:2656 excites
Feeds later layers
- L17:892 suppresses
- L13:1513 suppresses
- L14:2169 suppresses
- L13:2328 excites
- L19:2054 suppresses
- L11:171 excites
- L16:1938 suppresses
- L19:1981 suppresses
- L16:1129 suppresses
- L14:2556 suppresses
- L13:1001 excites
- L11:122 excites
- L20:38 excites
- L12:576 suppresses 'of' in fixed phrases like table of contents
- L14:1403 suppresses
- L16:882 suppresses
- L13:450 excites
- L14:1090 suppresses
- L19:1432 suppresses
- L15:1317 suppresses
- L14:1641 excites
- L16:2166 suppresses
- L16:1246 suppresses
- L15:1299 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- enerate
- lian
- [,]
- ReadStream
- enerative
- 馨
- LJ
- rarian
- istency
- [^
Suppresses
- >>&
- zeichnet
- usted
- 很好地
- ECH
- .docs
- för
- "..
- 主场
- 者