verb slot after treaty or agreement
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small word that comes right before a verb, mostly when the subject is a treaty, convention or agreement, as in 'the treaty was' before 'signed'. Turning it up made the model write 'sign' and 'signal' words over and over, which fits the idea that it is preparing the word 'signed'.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
want to communicate with. The private part is for the recipient's use only.⏎When you send personal information to dell.com, you use Dell's public key to encrypt your personal information. That means, if at any point during the transmission your
-
the Bali Declaration.⏎About Minamata Convention on Mercury⏎- The Minamata Convention on Mercury is the most recent global agreement on environment and health. It was adopted in 2013 and entered into force August 16,
-
818 Adams and President James Monroe resumed efforts to acquire Florida and a western boundary for the Louisiana Purchase. After months of negotiations, the Adams-Onís Treaty was signed on February 22, 18
-
his city's role in the Trans-Atlantic slave trade. He acknowledged that London was "tainted" by it<|endoftext|>Nearly three months after the Treaty of Paris was signed ending the American Revolution, the last British soldiers withdraw from New York City,
-
agreed that Texas was on the Spanish side of the line, and Spain agreed to give up its claim to the Northwest Territory north of forty-two degrees. The treaty was approved by the U.S. Senate on February 24, 18
-
housing, health and educational needs as well as economic, social and cultural rights.⏎The United Nations Convention on the Rights of the Child, to which New Zealand is a signatory, says that social services is also about ensuring that in all that we
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the hard working hard working hard working hard working hard working hard working hard working hard working hard working hard working hard working hard working hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard hard
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
build new nature-inspired devices. Think: Cat-tongue-inspired hairbrush, flexible arms to pick up fruit, and robots that walk on water.⏎Rex Walheim has some
-
to do with the success I have enjoyed as a man,” Peterson said in a statement.⏎Among those coming to Peterson’s defense was NBA Hall of Famer Charles Barkley. On the CBS pregame show The NFL Today, Barkley recalled childhood
-
, some of the vertebrate tongues, and the elephant trunk. These structures are composed solely of muscles used to generate movement and provide the necessary skeletal support (Kier, 1982; Smith and Kier, 198
-
, as well as the residence of his official mistress, Anne, Duchess of Étampes. Francis appears as the patron of Benvenuto Cellini in the 1843 French novel L'Orfèvre
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:1449 excites
- L23:2320 excites
- L24:1188 suppresses
- L23:2878 suppresses
- L22:1839 excites
- L24:1706 excites
- L16:56 weakly suppresses
- L2:1142 weakly excites
- L18:221 weakly excites
- L9:1628 weakly excites
- L18:191 weakly suppresses
- L19:1630 weakly excites
- L25:2254 weakly excites
- L18:2554 weakly excites
- L10:10 weakly excites
- L25:1526 weakly suppresses
- L4:871 weakly excites
- L25:251 weakly suppresses
- L19:2726 weakly suppresses
- L21:2327 weakly suppresses
- L14:246 weakly suppresses
- L0:2122 weakly suppresses
- L8:1274 weakly suppresses
- L21:2590 weakly suppresses
Feeds later layers
- L27:1453 strongly excites
- L27:1819 weakly excites
- L27:2107 weakly excites
- L27:2261 weakly suppresses
- L27:522 weakly suppresses
- L27:2285 weakly suppresses
- L27:2402 weakly excites
- L27:3037 weakly suppresses
- L27:2924 weakly suppresses
- L27:1867 weakly suppresses
- L27:2926 weakly excites
- L27:653 weakly excites
- L27:298 weakly suppresses
- L27:2082 weakly excites
- L27:827 weakly excites
- L27:2032 weakly suppresses
- L27:1787 weakly excites
- L27:2357 weakly suppresses
- L27:654 weakly suppresses
- L27:1762 weakly excites
- L27:1640 weakly excites
- L27:876 weakly suppresses
- L27:1767 weakly suppresses
- L27:1882 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- sign
- signs
- sign
- Sign
- Sign
- .sign
- (sign
- Signs
- _sign
- SIGN
Suppresses
- leness
- .tencent
- IEWS
- ollections
- .defineProperty
- DispatchQueue
- .TestCase
- 因地制宜
- erry
- entityManager