'for' after 'known' or 'renowned'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'for' when it follows praise words like 'known' or 'renowned', as in 'known for his charity'. Turning it up made the model write loose, rambling stories that did not clearly relate to the prompt.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ensure that the process of arbitration was carried out properly. All of 13th century Christian Europe willingly looked upon him as an international judge.⏎He was renowned for his charity. “The peace and blessings of the realm come to us through the
-
Attacks⏎The Dog Breed Known As Great Danes⏎Great Danes are widely assumed to be the biggest of all dog breeds around the globe. They’re renowned for their majesty and imposing presence. While they are often gentle in nature and even
-
short history has resulted in a rich blend of cultural and traditional customs. All Americans are renowned for their openness and friendliness to visitors. As a rule, dress is casual;
-
of Information in 1918, and especially as Minister of Aircraft Production in 1940. He is best known for his newspaper empire, including the Express and Evening Standard newspapers which gained record circulation.
-
, politician and civil rights leader. He was known for striving to better relationships between black residents and the police force, and he was a
-
a streetscape panel displayed on Roybal campus showing the original and expanded areas of CDC’s campus.<|endoftext|>Woods Hole Oceanographic Institution (WHOI), renowned for its role in the discovery of the Titanic, continues on its mission of research at
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
man of the people.” It’s even odder that he’s accused of being a “leftist.” In fact, he’s the son of a wealthy rancher once accused of killing leftist leaders, whose bodies were found hidden on the family ranch
-
2 1 min read⏎It’s always a good day to thank farmers, ranchers and agri-food workers because they literally keep us alive, but it makes extra
-
merer Early Horse⏎Utah Museum of Natural History⏎Courtesy & © Mary Heers, PhotographerIn 1928 Elmer Cook, a rancher in Hagerman, Idaho, noticed an interesting bone sticking our of the hill
-
permits, those permits would be subject to challenge in federal court, delaying or halting these activities resulting in a huge impact on rural economies.⏎Farmers and ranchers do a good job taking care of the land. As I often say, they
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1301 suppresses
- L0:178 suppresses
- L0:1224 weakly suppresses
- L0:2676 weakly suppresses
- L0:488 weakly excites
- L0:679 weakly suppresses
- L0:494 weakly suppresses
- L0:572 weakly excites
- L0:1411 weakly excites
- L0:21 weakly suppresses last digit of years like 1970
- L0:3009 weakly excites
- L0:2347 weakly excites
- L0:1960 weakly excites unclear: mixed medical and harsh words
- L0:1391 weakly excites
- L0:2606 weakly excites
- L0:193 weakly excites
- L0:950 weakly excites
- L0:1356 weakly suppresses
- L0:1555 weakly suppresses
- L0:2930 weakly excites
- L0:2128 weakly excites
- L0:2440 weakly excites
- L0:482 weakly excites
- L0:1722 weakly excites
Feeds later layers
- L10:3001 weakly suppresses
- L7:369 weakly suppresses
- L15:300 weakly excites
- L2:435 weakly suppresses
- L18:3025 weakly suppresses
- L11:2249 weakly suppresses
- L20:857 weakly suppresses
- L2:2062 weakly suppresses
- L13:1936 weakly excites
- L7:1567 weakly suppresses
- L11:2462 weakly suppresses
- L27:1580 weakly suppresses
- L6:536 weakly excites
- L3:1136 weakly suppresses
- L9:2700 weakly excites
- L19:2678 weakly excites
- L13:2198 weakly suppresses
- L23:2275 weakly suppresses
- L12:1603 weakly excites
- L21:2159 weakly suppresses
- L17:2817 weakly suppresses
- L8:2435 weakly suppresses
- L4:1151 weakly suppresses
- L20:2180 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- coli
- hood
- Walters
- 举
- avit
- V
- ogy
- ppv
- Charg
- feather
Suppresses
- ermann
- Nederland
- elper
- reinc
- useParams
- 男朋友
- .invalid
- 自然是
- \application
- หลวง