'as' in 'as ... as' comparisons
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word 'as' when it is part of a comparison, such as 'as brave and strong as' or 'the same way as'. Pushing it up did not produce anything about comparisons, so the link to the text it produces is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
in that process, we need to think of sustainability as both reducing energy demand and protecting the health of the building occupants.”⏎Waring’s academic background is as diverse as the air he’s studying
-
the residence itself, or a brook falling down the sward between trees and bushes and clumpy growths. There are as many forms and kinds of gardens as there are persons who have gardens […].” –LHBGC, p.
-
fused, valvate, petaloid, often with a small fringe (the calyculus) below the perianth. Stamens the same number as and opposite to and fused to the petals; anthers mostly basifixed,
-
of the new WAP portal is also a calculator computing expressions with very long numbers. To make the output look better, the result is formated the same way as is it usually used with manual calculations.⏎Your task is to write the core part
-
the famous and prestigious Eleven Towns Race that takes place in his country. For years Piet has dreamed of proving that he is a skater as brave and strong as Pim Mulier -- but he had never imagined that his test would fall under
-
my lifetime, we’ve gone from technology being a shiny object–a TV–to being an indispensable part of one’s everyday life. Technology is changing as rapidly as you change the channels on the TV set. The challenge and opportunity in education is
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I don't know. So, the first part of the first part of the first part of the first part of the... maybe a little. something that. So, the first part of the first part of the first part of the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
. As spines cover the tops of their bodies, spiny king crabs are also called porcupine crabs. These spines not only distinguish them from other species of crab but offer porcupine crabs protection from potential predators.
-
a quarter equals 25%.⏎1/2 is bigger than 1/4.⏎Three ninths is one third, and eighths are bigger than ninths
-
Councils in areas where nodding thistle is still only just establishing, making it a legal requirement to control it.⏎Nodding thistle can be distinguished from Scotch thistle at the vegetative stage, as Scotch thistle has sp
-
polymers and other substrates. It can be configured to work with a variety of feeding systems, including continuous web.⏎How does Plasma Compare to Corona?Corona treatment is an electrical process that uses ionized air to increase
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:2292 excites 'than' in comparisons
- L9:1995 suppresses
- L8:1319 suppresses
- L11:2631 excites
- L11:2749 suppresses
- L11:2271 excites
- L7:934 excites
- L10:1329 suppresses
- L7:1316 suppresses
- L10:2173 excites
- L6:1828 suppresses
- L11:3010 excites
- L11:1756 suppresses
- L7:2946 suppresses
- L4:1330 suppresses
- L5:2323 suppresses
- L10:1763 suppresses
- L7:2514 weakly suppresses
- L7:1508 weakly excites
- L7:1401 weakly excites
- L5:2694 weakly suppresses
- L6:2605 weakly suppresses
- L10:1477 weakly excites
- L6:1339 weakly suppresses
Feeds later layers
- L15:2247 excites
- L15:1145 excites
- L14:2815 excites
- L16:2061 excites
- L14:1421 excites
- L15:2027 excites
- L15:2006 excites
- L22:1619 excites
- L15:775 excites
- L14:509 excites
- L13:362 excites
- L18:1925 excites
- L14:593 excites
- L13:1722 weakly excites
- L18:2753 weakly excites
- L17:439 weakly excites
- L19:1999 weakly excites
- L13:1701 weakly excites
- L15:1741 weakly excites
- L14:2243 weakly excites
- L20:952 weakly excites
- L14:2634 weakly excites
- L24:2936 weakly suppresses
- L19:2470 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 自己喜欢
- previously
- previous
- others
- Previous
- 先前
- previous
- précéd
- 以往
- 别人
Suppresses
- além
- ewing
- łącz
- reels
- /lists
- rua
- айл
- ray
- лист
- .DOWN