'well' in compound adjectives
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'well' when it starts a compound adjective like 'well-known' or 'well-organized', or in phrases like 'a well known fact'. Turned up, the model's text became repetitive and odd. Turned down, it produced looping sentences about 'the best' or 'young'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ons of England organized numerous uprisings. In the face of such strong and well-organized opposition, King John was forced to renounce certain rights and to grant
-
with minefields and traps. Following Prime Minister Narendra Modi’s decision to strike at terrorists across the Line of Control in 2016, Pakistan responded with well-tested covert tools—ratcheting up the levels of violence against Indian forces in
-
focuses on spreading appreciation for the arts and academics all throughout Asia and Europe. One of the latest acquisitions of the organisation is Kubota’s kimono collection, a well-acclaimed exhibit of the late Itchiku Kubota, a textile artist in
-
At the conclusion of the novel, Gilly still faces difficult choices, but she knows herself better and is able to judge others more soundly. Paterson's well-d
-
, stability factors and, last but not least, reaction speed. Countless sporting activities and games such as running, jumping but also catching or throwing objects require some well-developed motor skills that will allow the child to participate in them. So,
-
're gone.⏎The title of this well-known story comes from a poem by Sara Teasdale in which nature is depicted
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 300,000/1000/300,000/300,000/1000/300,000/30
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1 you to take the former path, to teach only naturalism. 2 They have asked you to reject the Science Education Standards adopted by the Kansas State Board of Education on August 11, 1999 (the "New
-
officer of police to institute any necessary proceedings at the cost of the defaulting council.⏎In 1901 the president of the Board of Trade it troduced a bill to continue the act until 1906
-
ayashi is Associate Professor in the Department of Media and Communication at City University of Hong Kong.⏎Atsushi Tago is Professor in the School of Political Science
-
take the Library.?1 This is from the ?Prospectus? for Horace Mann?s The School Library, a series of books endorsed by the state Board of Education for use in Massachusetts? newly formed district school libraries. The promotion of ...⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1248 excites
- L19:1578 excites
- L19:1225 excites
- L20:1976 excites
- L4:521 suppresses
- L20:2482 weakly suppresses
- L20:1536 weakly excites the word 'well' in phrases
- L20:2698 weakly excites
- L18:2193 weakly excites "well" before known or documented
- L5:1755 weakly excites
- L8:2961 weakly excites
- L19:1159 weakly suppresses
- L15:2846 weakly excites
- L20:743 weakly excites
- L20:679 weakly suppresses
- L11:429 weakly suppresses
- L18:1729 weakly excites
- L13:562 weakly suppresses
- L8:2801 weakly excites
- L9:2208 weakly suppresses
- L18:736 weakly suppresses
- L4:1772 weakly excites
- L18:192 weakly suppresses
- L3:2566 weakly suppresses
Feeds later layers
- L24:422 strongly excites
- L23:575 excites
- L27:217 excites
- L27:716 excites
- L27:1211 excites
- L26:138 excites
- L27:869 excites
- L26:1940 excites
- L25:644 excites
- L26:395 excites
- L26:149 excites
- L22:494 excites
- L22:200 excites
- L25:149 excites
- L27:1832 excites
- L26:632 excites
- L23:740 excites 'well' in well-dressed, well-known, well-off
- L24:733 weakly excites
- L24:239 weakly excites
- L22:667 weakly excites
- L26:144 weakly excites
- L26:596 weakly excites
- L25:349 weakly excites
- L27:1281 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- -written
- -formed
- formed
- constructed
- formulated
- owned
- written
- spelled
- placed
- built
Suppresses
- osal
- ぐ
- 全身
- ocity
- SALE
- zej
- メント
- ')(
- xcf
- éments