'the' after 'is' or 'was' before a role
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'the' right after a verb like 'is' or 'was' when it introduces someone's role or title, as in 'he was the first'. Turned up, the model got stuck repeating 'the result of the', which fits its focus on the word 'the'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
1236⏎|Died||1301 (aged 64–65)⏎Violant was born in Zaragoza, the daughter of King James I of Aragon (1213–12
-
- FRONT OF HOUSE⏎- AFTERWORD / THE PERFORMERS⏎Robert Sutherland-Cohen is the Associate Professor of Stage Management and Production Manager at Brooklyn College. He has been production
-
the rate of the global average.1⏎Gayle Tzemach Lemmon, a senior fellow at the Council on Foreign Relations as well as a journalist and the best-selling author of The Dressmaker of Khair Khana, believes that full
-
City & Regional Planning and Historic Preservation at the University of Pennsylvania Stuart Weitzman School of Design. A social and cultural historian of the built environment, she is the author of Bulldozer: Demolition and Clearance of the Postwar Landscape
-
of the Leopold Leadership Program at Stanford University. He is also the director of the Tree Biosafety and Genomics Research Cooperative at OSU that conducts
-
help measure brown fat deposits that aid in non-shivering thermogenesis.<|endoftext|>Gruoch of Scotland⏎Gruoch (* 1015) was the daughter of Bodhe, Prince of Scotland, and granddaughter of Kenneth III .. At
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the most powerful ....................................................................................................................................
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, this function is only declared as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++.⏎/* memchr example */⏎int main ()⏎char * pch;⏎char str = "
-
00) ⇒ #<marker at 100 in markers.texi>⏎;; Now insert one character at the beginning of the buffer: (goto-char (point
-
the problem of a two way lookup comes up quite often. In this article we explore 4 methods of how to conduct 2D lookups in Excel.⏎+++NEW+++NEW+++NEW+++ 2D XLOOKUP +++NEW+++NEW
-
Enchanted Learning website for:|⏎Copyright ©2002-2016 EnchantedLearning.com ------<|endoftext|>Next analogy uses the fresh etymology out of spam-unwanted rubbish email-to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:1234 suppresses
- L16:2248 suppresses
- L9:662 suppresses
- L10:120 suppresses
- L10:1377 weakly suppresses
- L16:1212 weakly suppresses
- L2:2910 weakly excites
- L13:1345 weakly excites
- L1:1864 weakly suppresses
- L12:1990 weakly suppresses
- L3:1459 weakly excites
- L3:103 weakly excites
- L11:875 weakly suppresses
- L4:2742 weakly excites
- L10:221 weakly excites
- L17:2135 weakly excites 'the' after 'of' and similar words
- L17:35 weakly suppresses
- L3:1245 weakly excites
- L15:95 weakly suppresses
- L15:1848 weakly suppresses
- L17:2779 weakly suppresses
- L14:790 weakly excites
- L10:1924 weakly excites
- L11:259 weakly excites
Feeds later layers
- L20:2587 excites
- L20:2993 excites
- L19:3054 excites
- L23:1486 excites
- L19:1410 excites
- L21:2577 excites "the" in size comparisons
- L22:438 weakly excites
- L19:2973 weakly suppresses
- L19:2165 weakly excites
- L22:1824 weakly suppresses
- L25:823 weakly suppresses
- L20:2506 weakly excites
- L23:1149 weakly excites
- L20:2661 weakly suppresses
- L21:1422 weakly suppresses
- L24:2914 weakly suppresses
- L20:2625 weakly suppresses
- L22:202 weakly suppresses
- L20:2851 weakly excites
- L19:1725 weakly suppresses
- L19:1120 weakly suppresses
- L19:483 weakly suppresses
- L19:1775 weakly excites
- L20:1810 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- aines
- vic
- 谁知道
- ผล
- idenav
- amentos
- imentos
- ODY
- [result
- readcrumbs
Suppresses
- nnen
- ocytes
- vens
- filters
- Planner
- Filters
- agus
- Filters
- SPACE
- FILTER