'than' in comparisons
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "than" when it follows a comparison, like "faster than" or "more likely than". When it was turned up, the text drifted into repetitive or unrelated sentences, so the steering did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
either a dark black hand or a white hand. Though the cards themselves were the same, cards held in a black hand sold for about 20 percent less than cards held in a white hand. What’s more, “the race effect was
-
needs. Public charter schools are free, non-discriminatory, and do not have special entrance requirements. Ample evidence suggests that public charter schools perform better than traditional public schools on a national level, particularly for low-income students of color.
-
crashes and more than 350,000 were treated in emergency departments. Drivers aged 16 to 19 are four times more likely than older drivers to crash for every mile driven.⏎The graduated licensing programs are meant to
-
Sardinella anchovia). In some areas, the terms anchovy and sardine are used interchangeably. In addition to being slimmer and smaller than sardines,
-
between the hourly wages earned by men and women in the labor market, expressed as a percentage of men’s average wage. Women are generally considered to be paid less than men. There are two distinct numbers regarding the pay gap: unadjusted versus adjusted
-
. In China, from the 5th cent. B.C., when it was first used, calligraphy has always been considered equal, or even superior, to painting. Chinese calligraphy began with a simplified seal script, known as "ch
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "The story of the House of the Seagull" is one that has always been told with a sense of mystery and intrigue. The house is a place of wonder and the Seigend's family. The story of the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
fairly vanilla neural networks called Alice, Bob, and Eve.⏎Ref: Learning to Protect Communications with Adversarial Neural Cryptography. arXiv - Computer Science > Cryptography and Security (21 October 2016) | ar
-
to everything we see today.⏎This composition indicates that Terzan 5 evolved its stellar populations as a dwarf galaxy, and must once have been much larger than it is now. As old stars explode in supernovae they spread newly created material huge
-
Add your thoughts below. You can sign in with Google, Twitter, Facebook, Yahoo! to get
-
transmission from infected pregnant women to their babies during pregnancy and breastfeeding while preserving the health of these children and their mothers.⏎The PROMISE (“Promoting Maternal-Infant Survival Everywhere”) study aims to enroll 7,950 HIV-inf
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:1828 suppresses
- L6:1477 suppresses
- L10:2213 suppresses 'to' or 'into' showing movement between two things
- L6:800 excites
- L4:1330 suppresses
- L9:2267 excites 'with' after exchange nouns
- L9:1144 excites
- L10:2773 excites
- L9:319 excites equals signs in maths and equations
- L9:1449 suppresses
- L4:1560 suppresses
- L8:1319 suppresses
- L6:2605 suppresses
- L4:2069 excites
- L10:1329 suppresses
- L5:1477 excites
- L9:533 suppresses
- L6:2066 weakly excites 'of' linking a category to its parent field
- L10:272 weakly suppresses
- L3:566 weakly excites
- L1:895 weakly excites
- L10:2698 weakly excites
- L9:1701 weakly excites "and" joining a pair of nouns
- L6:1084 weakly suppresses
Feeds later layers
- L13:2356 excites
- L16:1469 excites
- L15:2247 excites
- L15:1145 excites
- L13:545 excites 'of' or 'to' linking two things
- L12:1395 excites 'as' in 'as ... as' comparisons
- L16:2219 excites
- L18:1857 excites
- L12:2548 excites
- L16:1074 excites
- L14:2243 excites
- L16:520 suppresses
- L14:2079 excites prepositions after comparison words
- L14:1421 excites
- L12:2721 excites
- L16:686 excites
- L16:1999 excites
- L16:2061 excites
- L16:2521 excites
- L15:2006 excites
- L12:2855 excites
- L16:1830 excites
- L17:439 excites
- L12:2014 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- icz
- igos
- imated
- abei
- RTVF
- 'action
- 救命
- decess
- arend
- buch
Suppresses
- quotes
- uliar
- ущ
- fällt
- inclined
- 不完
- pp
- RING
- ща
- 곡