'than' in comparisons
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'than' when a sentence compares two things, such as 'far faster than' or 'more quickly than'. It is quiet, and slightly negative, on words that point to a different one of something, like 'another' or 'some runners'. Turning it down pushed the writing toward the word 'different' again and again.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
when we talk about instincts, and isn’t part of the more intellectual decision making processes, indeed it shunts them out of the way, and reacts far faster than we can consciously think.⏎Why does the amygdala want to make a copy
-
, had it not been for a tendency toward wild-eyed anti-communism on the American side, the Soviet Union may have collapsed under its own weight much sooner than it did. The stridence and belligerency emanating from Washington,
-
:⏎• Increased carbon emissions: As a major contributor to climate change, the burning of oil for heating and cooking purposes releases far higher levels of carbon into the atmosphere than more efficient off-grid fuels like LPG.⏎• Cost: Through a combination of
-
India has a trade deficit with China of nearly $50 billion, its largest with any country. Singapore, with a population about 240 times smaller than India, sells twice as many goods to China each year.⏎"Both sides are
-
AFs views drawing as a practice of “making” more than “taking” (Taussig 2011). Drawings are far less intrusive than photography, and encourage the necessity to take time, observe, wait, and get
-
others increase their happiness, it also increases our own. Studies amongst different cultures and ages have consistently found that individuals who spend money on others report higher levels of happiness than those who spend money on themselves. Researchers suggest that the reward we experience from helping
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The question and the meaning and the meaning of the same and the meaning of one may be different and the meaning of one may be different and the meaning of one may be different and the meaning of one may be different and the meaning of one
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
0% per week. Keep in mind, though, that everyone is different and that even 10% may be too much of a weekly mileage increase for some runners.⏎The causes of low bone density include genetics, poor dietary calcium or vitamin
-
helping your child address ADHD behavioral challenges. Again, each child is different, so it’s important to recognize that what is appropriate and works for one child might not for another. But these are good natural strategies to implement and see if they can help
-
or weekly bowel movements. Three bowel movements a day might be normal for one person, while three a week may be normal for another. Also, some people naturally have firmer stools than others.⏎At one time
-
concept of learning styles. Some of you wanted to know more about that.⏎Some folks learn a new concept in A&P best by hearing their instructor explain it. Some favor learning it from the textbook. Others need to play with specimens in the lab
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1912 suppresses
- L8:1830 suppresses
- L12:2918 excites
- L11:662 suppresses
- L12:276 suppresses
- L7:2400 excites
- L13:1768 excites
- L11:3023 suppresses gender and race in lists of identities
- L11:2186 excites
- L13:264 suppresses
- L13:818 suppresses
- L10:736 weakly excites
- L12:3007 weakly suppresses
- L12:626 weakly excites
- L12:1253 weakly excites
- L11:983 weakly suppresses
- L2:2776 weakly excites
- L7:2733 weakly excites
- L12:194 weakly excites
- L8:867 weakly suppresses
- L6:1251 weakly suppresses
- L1:2166 weakly suppresses
- L9:2603 weakly suppresses
- L9:2407 weakly excites
Feeds later layers
- L15:1922 suppresses
- L16:2807 suppresses
- L26:1060 suppresses
- L21:2973 suppresses
- L15:2440 suppresses word before 'and' or 'or' in pairs
- L23:875 suppresses
- L19:2976 suppresses
- L17:2541 suppresses comma before but also in not only constructions
- L15:2448 suppresses
- L25:648 suppresses
- L16:2051 suppresses
- L15:2002 suppresses
- L19:2205 suppresses
- L21:1090 suppresses
- L18:2942 suppresses
- L18:2761 suppresses
- L19:2308 suppresses
- L21:2296 suppresses
- L15:2015 suppresses
- L21:1056 suppresses
- L15:1585 suppresses
- L15:454 excites
- L17:1036 suppresses
- L20:944 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- built
- iom
- $__
- noun
- built
- pl
- ��
- acknowledge
- وم
- :\/\/
Suppresses
- 不同的
- 有不同的
- 不同
- 有所不同
- _different
- 不一样
- 不一样的
- Different
- different
- different