verb slot after a long subject
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small word that comes right after a long subject and before the main verb, such as 'have', 'has' or 'likely' in a sentence. Turning it up made the model repeat words like 'provided' and 'caused', which fits the kind of verb that would come next.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ing the states of Indiana, Ohio, Illinois, and Michigan. Convenient access to raw materials, skilled labor, and the shipping options available including the railroads, likely contributed to the concentration of these companies within this area. Another factor was a receptive
-
cultural contexts—from Appalachia and the rural Piedmont to New Orleans, the Black Belt of the Deep South, and the Carolina Lowcountry. These uniquely Southern settings have spawned equally unique musical forms.⏎Visit Event Page HERE!<|endoftext|>NORD is very
-
atic and European tectonic plates. The melting of glaciers and rise in sea levels after the last Ice Age, 20,000 years ago, made the mountains into an archipelago which was then eroded by the sea
-
team who are providing guidance to a literacy program for the displaced Massalit people of Darfur. Her upbringing, coupled with experience living in a Western culture, has become an
-
Supreme Court—failed the movement for black freedom and representation, the amendment process was critical to shaping the fight for racial equality. Indeed, it was the amendment process that created the legal basis to abolish slavery and assure equal political rights for black Americans.
-
I transformed humanitarian relief. The magnitude of the conflict, the extent of civilian suffering, particularly in occupied areas, and the destruction and consequences after the end of hostilities accelerated the rationalization of humanitarian relief. Organizations, both temporary and permanent, embraced
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how can continued satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames satenames sat
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
148 species assessed for population and distribution trends, 60 per cent have declined over the past 50 years; further research shows turtle dove numbers have plummeted by 80 per cent since 1995, hedge
-
⏎Although the number of operating longwall mining systems in the U.S. has remained relatively constant over the past five years, U.S. longwall production levels have increased significantly during this period. Longwalls account for over 40% of
-
that the number of new employer businesses has fallen 27% since 2006. The total number of startups (employer businesses and self-employed) has increased since the recession, according to the Kauffman Index of Entrepreneurial Activity.
-
simply did not exist. Prices fell through the 1980s but have slowly rebounded through the 90s, and in recent years prices have tended to fluctuate between $3 and $10 per board-foot, or
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:60 strongly excites
- L23:535 excites
- L23:127 suppresses
- L22:444 suppresses
- L19:2475 excites
- L22:479 excites
- L21:958 suppresses
- L20:2672 excites
- L24:239 suppresses
- L22:2258 excites
- L18:178 suppresses
- L21:1181 excites
- L23:108 suppresses
- L20:349 excites
- L25:848 suppresses
- L16:1532 excites
- L19:2161 excites
- L7:92 suppresses
- L24:778 excites
- L20:2524 suppresses
- L15:390 suppresses
- L15:184 suppresses
- L21:773 excites
- L19:1678 suppresses
Feeds later layers
- L27:1514 excites
- L27:1295 excites
- L27:1596 excites
- L27:2836 weakly excites
- L27:1567 weakly suppresses
- L27:2757 weakly excites
- L27:217 weakly excites
- L27:869 weakly excites
- L27:1275 weakly suppresses
- L27:820 weakly suppresses
- L27:988 weakly excites word before 'needed' or 'required'
- L27:1345 weakly excites
- L27:410 weakly suppresses
- L27:1946 weakly excites the letter z inside words
- L27:1876 weakly excites
- L27:382 weakly suppresses
- L27:1372 weakly suppresses
- L27:3068 weakly suppresses
- L27:2524 weakly excites
- L27:727 weakly suppresses
- L27:3070 weakly suppresses
- L27:1619 weakly suppresses
- L27:716 weakly excites
- L27:2703 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- provided
- caused
- Provided
- produced
- created
- provided
- generated
- offered
- supplied
- made
Suppresses
- ς
- уть
- 下了
- enames
- 笑了
- 让孩子
- usz
- _Metadata
- 맥
- sat