comparative or contrasting qualifiers
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words that set up a comparison or contrast, such as 'larger' individuals, 'slowly' versus sugars, 'superior' military force, or 'separate' memory. Turning it up or down did not produce a clear change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
), respectively. Results indicated that body size, standardized by sex, was the most important covariate determining survival of adult D. couperi, suggesting lower survival for larger individuals within each sex. We are uncertain of the mechanisms underlying this result, but
-
largely through farm-yard manure, supplemented with need-based fertiliser applications. The most significant aspect of SRI is that the fields are not kept submerged under water all the time, as is usual in rice farming, but are allowed to remain just
-
his son to go off on his own. In reality he lies about his trust for his son by sending a spy to
-
they are digested more slowly than simple sugars in white bread, for example. The slower digestion means that all
-
Whenever they are mentioned, people first think of how they can add them to a indulgent dessert, and nobody thinks of the Macadamias as a healthy food and a rich source of nutrients. Mostly the macadamias are replaced with cashews
-
athom—in no small part because of what George Washington and his soldiers achieved against all the odds that nature and a vastly superior military force could pit against them. … Because of their accomplishments, the waning
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I have been thinking about the way I have done it, but I have done it so much, I can't do anything, but I have done it so much, I have done it so much, I... I am... I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Bamyan, Afghanistan, where all that remains of the giant Buddhas carved into the cliffs are the indentations that once housed them. The Taliban blew these figures up with dynamite in 2001, viewing them as idols from a
-
indirect aggression triggers it. The "aggressor" talks behind a person's back<|endoftext|>You are using an outdated and unsupported browser.⏎This browser no longer meets the security requirements of the PCI Security Standards Council. Outdated browsers do not support the requirements
-
Inchworm Book Release⏎It wasn’t too long ago that arts education in schools was thought to be a luxury, and arts classes were cut from the curriculum to make room for more time to prepare for standardized tests. Currently
-
hey I tried right? So instead of deleting my short article I thought I would share it with my readers. I cannot use it for school purposes since I have to only use material found in our text. As a medieval scholar my final paper will
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:294 suppresses
- L12:877 suppresses
- L12:1049 excites
- L11:1697 suppresses
- L9:118 excites
- L12:193 excites
- L11:1537 excites
- L11:146 suppresses
- L11:1549 suppresses
- L12:1626 suppresses
- L11:11 excites
- L11:748 suppresses
- L12:302 weakly excites
- L9:710 weakly excites
- L12:945 weakly suppresses
- L12:480 weakly excites
- L12:2924 weakly suppresses
- L12:2011 weakly suppresses
- L12:1960 weakly suppresses
- L12:428 weakly suppresses
- L12:2610 weakly excites
- L12:841 weakly suppresses
- L12:1363 weakly excites
- L11:1592 weakly suppresses
Feeds later layers
- L15:1241 suppresses
- L15:1669 suppresses
- L14:2208 suppresses
- L14:2465 suppresses
- L15:1157 suppresses
- L17:1472 excites
- L14:131 excites
- L14:599 suppresses
- L22:1937 suppresses
- L15:58 excites
- L16:2492 suppresses
- L15:1357 excites
- L18:3031 suppresses
- L16:1729 suppresses
- L15:1563 weakly suppresses
- L14:1712 weakly suppresses
- L16:295 weakly excites
- L16:2576 weakly suppresses
- L14:478 weakly excites
- L15:1590 weakly suppresses
- L14:2858 weakly suppresses
- L16:2212 weakly suppresses
- L14:2604 weakly suppresses
- L14:1483 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 两类
- beit
- овый
- 一款
- mani
- pike
- voices
- connect
- 年产值
- ovic
Suppresses
- ,{"
- 以免
- 不允许
- 因为它
- 否定
- \Configuration
- freeing
- calor
- 辞职
- 原因