'for' after praise words like 'known for'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'for' right after words that describe being famous or valued, such as 'known for', 'valued for' or 'recognized for'. Turning it up did not produce a clear change in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
soccer game.⏎It’s really too bad that we have bought into these inaccurate interpretations of this story.⏎I feel bad for the character Thomas, who is only remembered for what he apparently did not believe.⏎It’s not a stretch to say that our
-
Chemical Activity of Copper:⏎The chemical activity of copper imparts unique taste and aromatic characteristics to beverages.⏎Despite their higher cost, copper stills are valued for their ability to create high-quality and flavorful alcoholic beverages.In copper stills, a
-
outgoing, they tend to chatter a lot and they are quite active little birds. They love to interact with their "flock" and are known around the world for their exceptional talking
-
below.⏎You can read a full overview at Wikipedia here.<|endoftext|>Aloe vera has long been considered as one of Mother Nature’s miracle plants, well-regarded for its healing, antioxidant, anti-inflammatory, and moisturizing properties, among others.
-
narrative of creation. As the<|endoftext|>Cinnamon contains large amounts of very powerful polyphenolic antioxidants.⏎The cinnamon is a spice that has been appreciated since ancient times for
-
land⏎(1808–1867) Hannah was born and raised in a Quaker family in Sherwood, NY and is best recognized for her work as an abolitionist. The home she shared with her husband, S
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the design of a modern car, and the current trend in the automotive industry is towards more efficient and higher performance. Therefore, the new car should be a more efficient and higher-performance than the previous models. This is what the design should be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Even though the British fleet's arrival in New York set off a flurry of panic amongst the Loyalist population. The news of the defeat was also not received well in London by King George III who is noted as saying that "after the knowledge
-
There are some tribes amongst them (for they are distinguished like the Jews by their tribes), among whom the crime of swearing by the name of the Virgin is punished with forfeiture of
-
above enactments and other allied laws for the smooth functioning of their business. Any company that doesn’t follow the rules listed in these enactments is subject to punishment by the government of India. It is to be noted that the organisations with large operations
-
welcomed spring and the dawn, why our word for "East" and "Easter" come from her name. Originally in Pagan traditions, Easter was celebrated with a feast to celebrate Ostara (the Old English spelling) the bringer of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:2203 weakly suppresses
- L3:2217 weakly suppresses
- L4:3067 weakly excites
- L3:1611 weakly suppresses
- L4:1539 weakly suppresses
- L5:2931 weakly suppresses
- L5:733 weakly excites
- L3:1747 weakly excites
- L5:2162 weakly suppresses
- L5:2636 weakly excites
- L4:1454 weakly excites
- L3:1651 weakly excites "on" in "went on to"
- L0:2779 weakly suppresses
- L4:2347 weakly excites
- L2:2938 weakly excites
- L2:2618 weakly suppresses
- L3:505 weakly excites
- L3:408 weakly suppresses
- L5:2058 weakly excites
- L0:1303 weakly excites
- L5:151 weakly excites
- L5:2094 weakly excites
- L5:2691 weakly suppresses
- L3:904 weakly excites
Feeds later layers
- L9:2451 excites 'for' giving a reason or cause
- L14:2404 excites
- L7:2581 excites
- L7:43 excites
- L18:2859 excites 'for' after an award or honour
- L17:1952 weakly excites
- L17:1820 weakly excites words of celebrating or promoting
- L18:2049 weakly excites
- L20:2795 weakly excites
- L17:2782 weakly suppresses 'same' in 'at the same time'
- L13:519 weakly excites
- L9:2545 weakly suppresses
- L13:2141 weakly excites end-of-text token after finished articles
- L10:1860 weakly excites
- L16:547 weakly excites
- L15:598 weakly suppresses
- L13:2791 weakly excites
- L20:1671 weakly suppresses
- L8:1510 weakly suppresses
- L20:1259 weakly excites
- L20:2306 weakly excites
- L14:882 weakly suppresses
- L11:374 weakly suppresses
- L12:2303 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- za
- trib
- 涤
- virtue
- ertia
- ocrat
- ấm
- CRT
- Containing
- pedig
Suppresses
- anean
- setDefault
- <<(
- rä
- aneous
- imentary
- vary
- uale
- قدير
- bah