unclear: words near 'common'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is weak and messy. Its strongest moments tend to fall on words that come right after or near the word 'common', such as 'commonly' or 'common symptoms', but many examples do not fit. Turning it down made the model repeat words like '3D' and 'cold'.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
(cooling) coils and circulates it throughout the refrigerator and freezer compartments. Some refrigerators have more than one evaporator fan motor. On refrigerators with only one evaporator, the evaporator is located in the freezer compartment. If the
-
taken object-oriented editing the furthest, as the program allows you to open up a clip and access a huge number of clip-related parameters. Sonar, on the other hand, was not designed with object-oriented editing in mind, and takes a
-
their conclusion.⏎"Our results suggest that losing just 5 percent or more of one's weight could cut by a quarter to a half the risk for the most common, estrogen-sensitive breast cancers," McTiernan said.<|endoftext|>Is Peru a rich
-
the most common pediatric fractures encountered in the emergency department. Supracondylar fractures account for more than 60 percent of elbow fractures, followed by lateral (20%) and medial (
-
after the last drink, but can occur days later. Symptoms usually peak by 24 to 72 hours, but may go on for weeks.⏎Common symptoms include:⏎- Anxiety or nervousness⏎- Jumpiness or shakiness⏎
-
typical milk snakes with their red, black and yellow rings. As they mature, however, their colors darken until the snakes are uniformly black. Some scientists believe the development of black pigments in this subspecies (type) of milk snake is a
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 30000000000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
consumed all over the world. For example, in the United States and North-Central Europe yogurt is made from cow’s milk, while sheep’s and goat’s milk is used in Turkey. In Egypt and India, yogurt is made from milk of
-
show bias than that of women. And scientists in countries with very strong incentives to publish, such as the United States, didn’t seem to have more bias than studies from countries where the pressure was less. These results confirm, with much greater accuracy
-
the United States is different from the laetrile/amygdalin produced in Mexico. The patented Laetrile
-
33 years in average life span over the past century. A baby born today can expect to live an average of 78 years, compared with 45 years back in 1900. But those gains have not been uniform
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:355 suppresses
- L17:2307 suppresses
- L15:437 excites
- L16:371 excites
- L18:210 weakly suppresses
- L18:1923 weakly suppresses
- L13:1891 weakly suppresses
- L16:1181 weakly excites
- L16:1007 weakly suppresses
- L19:2101 weakly suppresses
- L17:2092 weakly suppresses
- L13:380 weakly suppresses
- L14:223 weakly excites
- L19:464 weakly suppresses
- L16:2490 weakly suppresses
- L18:1037 weakly suppresses
- L15:696 weakly suppresses
- L18:556 weakly suppresses
- L11:562 weakly excites
- L16:3059 weakly suppresses
- L13:2994 weakly suppresses
- L6:883 weakly suppresses
- L15:678 weakly suppresses
- L15:1079 weakly suppresses
Feeds later layers
- L24:104 excites
- L22:106 excites
- L22:119 weakly excites
- L21:170 weakly suppresses
- L21:323 weakly excites
- L21:98 weakly excites
- L27:361 weakly suppresses
- L21:843 weakly excites
- L22:449 weakly suppresses
- L21:324 weakly suppresses
- L24:85 weakly suppresses
- L27:2995 weakly excites
- L24:249 weakly suppresses
- L22:29 weakly suppresses
- L21:1126 weakly excites
- L24:761 weakly excites
- L27:1884 weakly excites
- L23:348 weakly excites
- L25:1612 weakly excites
- L23:355 weakly excites
- L27:3065 weakly excites
- L23:1393 weakly suppresses
- L26:486 weakly suppresses
- L21:1171 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ông
- iological
- рак
- erokee
- adget
- �建
- alph
- logistical
- _dom
- .INTERNAL
Suppresses
- | ⏎
- ")] ⏎
- # ⏎
- $ ⏎
- ` ⏎
- | ⏎
- ⏎→ ⏎
- ** ⏎
- }) ⏎
- 恶心