"even" before a comparative
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "even" when it comes before "more", "worse" or "greater", as in "even more roadblocks". The steering results were unrelated to this, so the link is only seen in the examples.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
in science, technology, engineering, and math (STEM) positions is an ongoing concern. And the challenges brought on by the unprecedented COVID-19 pandemic created even more roadblocks for many of us.⏎According to a survey from Environment and Climate
-
, they have received comparatively little attention from taxonomists. Had it not been for their importance as parasitoids of insect pests, the group would have received even less attention. Yet evidence from the British fauna and detailed work in tropical America suggests
-
tremendous strain on electrical systems, as seen during Texas’s deadly winter storm. Summer blackouts may become even more common, and deadlier, as temperatures soar. The energy required to save
-
alusia exported olive oil to Italy and other Mediterranean countries during this era. When Andalusia later fell under Islamic rule, olive oil cultivation expanded and became an even more vital part of the regional economy.⏎Today the land is known for its iconic
-
of homes in predominantly white neighborhoods has appreciated considerably in the last 50 or so years. This development has a dual effect: It makes homes in those neighborhoods even more unattainable for African Americans and it entrenches the intergener
-
arcus, Forsyth, Stone, Dubbert, McKenzie, Dunn & Blair 2000) This lack of physical activity among the elderly is of even greater concern when considering the changing demographics.⏎The intention to perform a behavior is the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first step in the game of math, addition, and the sum of the numbers formed by two numbers to the sum of two numbers to the 200000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
possibly represents a significant part of the future of organic chemistry with its potential role in developing, for example, man-made molecular switches or molecular muscles. The work on rotax
-
: 2011-10-14⏎Credited as : manufacturer, blue jeans, Levi Strauss & Co.⏎Levi Strauss made and sold blue jeans in San Francisco, California, during and after the gold rush.
-
September 27, 1975. The Privacy Act is essentially an omnibus "code of fair information practices" that attempts to regulate the collection, maintenance, use and dissemination of personal information by federal executive branch agencies. These amendments
-
is up to, and she slams the window sash on his beard. Trapped, he must
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2252 weakly excites
- L2:1655 weakly excites
- L6:2075 weakly suppresses
- L5:2319 weakly excites
- L0:1239 weakly excites
- L3:2483 weakly suppresses
- L2:500 weakly suppresses
- L7:1449 weakly excites
- L6:1161 weakly excites
- L7:400 weakly excites
- L3:57 weakly excites
- L5:2113 weakly suppresses
- L1:1374 weakly excites
- L7:1978 weakly excites
- L6:1066 weakly excites
- L1:352 weakly excites
- L3:885 weakly suppresses
- L0:332 weakly suppresses
- L1:1576 weakly suppresses
- L7:2013 weakly suppresses
- L4:2571 weakly suppresses
- L1:2552 weakly suppresses
- L6:1892 weakly excites
- L5:1134 weakly excites
Feeds later layers
- L9:758 excites
- L14:1337 excites
- L17:2660 excites
- L10:991 weakly excites
- L9:434 weakly excites comma after an adjective in a list
- L19:2194 weakly excites first half of hyphenated compound adjectives
- L24:2855 weakly excites
- L15:461 weakly excites
- L23:1726 weakly excites
- L20:1976 weakly excites
- L14:1332 weakly suppresses
- L18:1456 weakly excites
- L27:153 weakly suppresses the spot just before a historical number
- L9:707 weakly excites
- L23:366 weakly excites
- L15:1959 weakly suppresses
- L16:1406 weakly excites
- L17:968 weakly excites
- L16:1819 weakly excites
- L15:778 weakly excites
- L20:1979 weakly excites
- L19:1956 weakly suppresses
- L18:551 weakly suppresses
- L23:283 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ಠ
- aveled
- -headed
- JR
- obsolete
- sé
- 善意
- achable
- Writable
- 过剩
Suppresses
- imum
- 安阳
- ippi
- ницы
- isor
- erg
- programma
- ients
- яти
- enheim