'with' after exchange nouns
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'with' when it follows a noun about exchanging or relating to someone, such as letters with a friend, talks with a leader, or an agreement with a group. When it was turned up, the model's replies did not show a clear change in theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
correspondence, one of the best- preserved collections of letters from the period, shows that he exchanged letters constantly with his friends elsewhere, keeping them up to date with the latest political machinations,
-
your choice, fill out an order form for merchandise as if you⏎intended to place an order. Share the completed form with your counselor and discuss⏎- With your parent's permission, locate at least five Web sites that are helpful for⏎
-
delegated to the United States, in Congress assembled.⏎Provide for common defence was:⏎Article III. The said States hereby severally enter into a firm league of friendship with each other, for their common defense, the security of their liberties, and their
-
-known material from the UK National Archives. Includes James' own description of the Battle of Edgehill, his reasons for his conversion to Catholicism, and his correspondence with William of Orange.⏎A Court in Exile: The Stuarts in France
-
breed in aquarium environments.<|endoftext|>Donald Trump became the first serving American president to meet with a North Korean leader in June 2018.⏎Trump’s talks with North Korean Leader Kim Jong Un in Singapore led to an agreement in which the two
-
region and own and manage the remaining 2.7% of the Watershed.⏎The Yukon has several First Nation Final Agreements (“Final Agreements”) with various Yukon First Nations. These Final Agreements adopt terms from what is called
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about it, and I have been thinking about it, and I have been thinking about it, and I have been thinking about it, and I have been thinking about it, and I have been thinking about it, and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
patients. Based at University of Chicago, they hypothesize that it’s the ‘abnormal’ gut microbes, those that survive the extreme amount of antibiotics thrown at these patients that eventually turn deadly.⏎“Nobody had asked what happens to bacteria in
-
to aim your stream of water directly onto the soil. Watering at the top of the plant will not get the roots
-
or dead.⏎When the king killed Arbsima, the virgin, and all the virgins who were with her, he also ordered that their bodies be cast away on the mountains. Later
-
which can eventually lead to a heart attack. The purpose of an angioplasty is to clear plaque and cholesterol build up in the coronary arteries to improve blood flow to the heart.⏎The procedure for performing an angioplasty involves the use of a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:910 excites
- L8:1862 suppresses
- L8:1627 excites
- L6:2842 excites
- L4:1330 suppresses
- L6:800 excites
- L7:2766 suppresses
- L8:45 suppresses
- L6:1477 suppresses
- L4:328 suppresses 'to' after 'so as' and infinitive cues
- L6:1828 suppresses
- L5:1624 excites 'from' after 'Retrieved' and source phrases
- L3:2669 excites
- L5:2877 excites
- L8:2632 suppresses
- L6:1534 suppresses
- L5:1535 suppresses
- L4:882 weakly suppresses 'with' after provide or familiarize
- L6:1956 weakly suppresses "for" introducing a purpose or source
- L7:1959 weakly excites
- L6:742 weakly excites
- L2:863 weakly suppresses
- L7:2748 weakly suppresses
- L8:216 weakly excites
Feeds later layers
- L13:2116 excites
- L18:1857 excites
- L15:2247 excites
- L10:297 excites
- L16:1999 excites
- L10:2278 excites
- L11:437 excites
- L19:1434 excites
- L11:881 excites "with" after combine, mix or react verbs
- L20:1794 excites
- L11:2292 excites 'than' in comparisons
- L12:2014 excites
- L15:799 excites
- L16:1469 excites
- L16:490 excites
- L23:316 excites
- L17:2197 excites
- L19:1024 excites
- L17:2591 excites
- L16:564 excites
- L14:2508 excites
- L18:56 excites
- L15:1305 excites
- L19:2845 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- gegenüber
- 朋友
- entifier
- peers
- 当地人
- 别人的
- 队友
- 对方
- 当地政府
- 别人
Suppresses
- ecure
- case
- Ping
- casts
- ATCH
- ews
- 싱
- Ping
- ело
- esthesia