'of' in 'one of the' phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'of' right after 'one', as in 'one of the best' or 'one of my patients'. When it was turned up, the model's replies drifted into wordy, rambling text, which doesn't clearly reflect the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
should consume to treat a specific medical condition<|endoftext|>A species on the brink – Freshwater Pearl Mussel⏎They can live for over a century, they have one of the most bizarre life-cycles of any species you’re likely to find and they
-
.D. Anderson Cancer Center in Houston. “I’ve always felt the same way, and I tell my patients the same thing.”⏎“Just last week, one of my melanoma patients came in with a sunburn all over their back, and
-
this article should be taken as medical advice. Please talk to your doctor before using any of the herbs and/or remedies mentioned in this article. Yarrow is one of the oldest medicinal herbs, dating back thousands of years and used for various ailments.
-
Agatha Christie’s mysteries. Christie often portrayed the detective as referring to himself in the third person, as a way of depicting his self-grandeur. In one of her books, another character asks him about it:⏎- Dr. Lutz:
-
and consequently the subjects included in<|endoftext|>Authored by Gayathri Vasudevan, Sambhav by LabourNet⏎Did you know that India has one of the best recycling rates in the world? 70% of all PET bottles
-
fish abundance and distribution trends between locations. Armed with the knowledge of where<|endoftext|>Edited by William Byron Forbush This is a book that will never die — one of the great English classics. . .
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: that of how, in and by, of time, a person can see and by time, of a person in new and by, of new and by, of new, person, in new and by, of new and by, of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
-hour recall of what they had consumed. Only 25 percent reported eating any meat, which historically was a diet staple, and many of them had only had one meal in 24 hours. Some had not eaten at all.⏎The Central
-
father.⏎People who inherit the transmuted hemoglobin gene from both biological parents have sickle cell anemia. People who inherit the transmuted gene from one parent have the sickle cell trait.⏎What Raises One’s Risk for Sickle
-
S U.⏎No direct anagrams for focus found in this word list.⏎List shorter words within focus, sorted by length⏎All words formed from focus by changing one letter⏎Browse words starting with focus by next letter<|endoftext|>I was listening to Brooke
-
as hypomania. Hypomania is one of the most distinguishing bipolar type 2 signs. In order to be classified as bipolar type II, at least one hypomanic episode must occur and must last at least four days.⏎In severe
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:1012 weakly excites 'one' before 'of' in 'is one of the'
- L16:551 weakly excites
- L5:133 weakly excites
- L3:283 weakly excites
- L2:2828 weakly suppresses
- L0:1 weakly suppresses
- L13:1720 weakly suppresses
- L10:1575 weakly excites
- L1:2355 weakly excites
- L2:126 weakly excites
- L7:806 weakly excites
- L14:17 weakly suppresses
- L10:2627 weakly suppresses
- L5:2272 weakly excites
- L15:280 weakly excites
- L16:222 weakly suppresses
- L5:1713 weakly suppresses
- L14:1764 weakly suppresses
- L16:143 weakly excites
- L6:1782 weakly suppresses 'of' after a category noun
- L1:818 weakly excites
- L0:2785 weakly suppresses
- L15:1454 weakly excites
- L9:2817 weakly suppresses
Feeds later layers
- L20:807 excites
- L24:434 excites
- L24:489 suppresses
- L19:654 weakly suppresses
- L26:441 weakly suppresses
- L23:79 weakly excites
- L24:360 weakly suppresses
- L18:520 weakly excites
- L19:2593 weakly excites
- L19:1570 weakly suppresses
- L21:913 weakly excites
- L19:2358 weakly excites "any of" before "these" or "the"
- L25:390 weakly suppresses
- L22:260 weakly suppresses
- L18:1433 weakly excites
- L27:1260 weakly excites
- L25:284 weakly excites
- L21:918 weakly suppresses
- L22:211 weakly suppresses
- L19:1695 weakly suppresses
- L25:320 weakly suppresses
- L20:602 weakly suppresses
- L21:392 weakly excites
- L19:959 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ials
- ités
- eties
- align
- ologies
- them
- аст
- them
- achers
- ilities
Suppresses
- 网首页
- 一个小
- ONGL
- chù
- sebuah
- группа
- carpet
- awy
- 침
- -dat