'way' before a how-to phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'way' (or a similar noun or verb) right before a phrase that explains how something is done or why, as in 'an easier way to raise' or 'a formal way of thinking'. It is weakly negative on words like 'pain'. Turning it up made the model repeat simple phrases, which only partly fits.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
unique sounds for a reason. There are many stories behind the letters we use so often. The earliest forms of writing evolved because members of ancient civilizations needed more efficient ways to express themselves. Listen to this story to hear about the origins of individual letters
-
attention of children. Now the television is in competition with other devices -- computers, video games and smartphones. All of these screens offer entertainment, information, and a way to keep in touch with and stay connected to others.⏎With the arrival of the
-
nails. The skin serves many functions, including protecting us from microbes and the elements, helping to regulate body temperature, and receiving sensory
-
give us something to look forward to, provide a social outlet, allay worries about health and fitness, increase energy levels, and improve self
-
including the railroads, likely contributed to the concentration of these companies within this area. Another factor was a receptive and growing market of customers in need of an easier way to raise
-
. The spread of memes has significantly shaped how people communicate, and they have played a fundamental role in advancing the contemporary digital culture. Memes provide a compelling new way of blending a few things such as art, creativity, humor and the intended message
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The key point is that the same point is in the same line (or on the same plane, e.g., on the same line as the point, the line is parallel to the point, and the point is either on the same line
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
colon due to the intense pressure that comes from a lack of fiber. Diverticulitis is when the pouches become inflamed or infected and cause abdominal pain.⏎Coffee has one of the higher caffeine counts, ranging in caffeine from 6
-
is a common sign of appendicitis, especially in children. When the appendix becomes inflamed, it can swell and fill with pus. This can cause severe pain, nausea, and vomiting. Swelling is therefore an important symptom to watch for
-
help at Expertsmind⏎Are you searching Operations Management expert for help with Characteristics of Linear Programming questions? Characteristics of Linear Programming topic is not easier to learn without external help? We at
-
fight the infection. The increase in white blood cells can lead to a fever. A fever may also be accompanied by other symptoms of appendicitis, such as pain, swelling, and loss of appetite.⏎Gas is another common symptom of appendicit
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:2544 suppresses
- L7:1198 suppresses
- L8:796 excites
- L10:451 excites
- L9:1716 weakly excites
- L7:1743 weakly suppresses
- L3:2789 weakly excites
- L10:2920 weakly excites
- L10:1219 weakly suppresses
- L8:840 weakly suppresses
- L5:2141 weakly excites
- L8:1184 weakly suppresses
- L9:1281 weakly excites
- L9:1618 weakly excites
- L9:1497 weakly suppresses
- L10:2094 weakly excites
- L10:2165 weakly excites
- L2:2932 weakly suppresses
- L10:1308 weakly suppresses
- L7:271 weakly excites
- L10:2447 weakly excites
- L8:1936 weakly excites
- L8:1464 weakly suppresses
- L10:1856 weakly suppresses
Feeds later layers
- L13:678 excites
- L12:913 suppresses
- L14:2778 excites
- L13:2607 excites
- L12:1670 excites
- L12:493 excites
- L13:2577 excites
- L13:1363 excites
- L12:2283 excites
- L12:363 excites
- L14:2357 excites
- L12:2369 excites
- L12:2060 excites
- L14:2307 suppresses
- L15:3047 excites preposition introducing a definition or date
- L14:284 excites
- L13:1203 suppresses
- L20:2197 weakly excites
- L17:1705 weakly excites
- L13:2424 weakly suppresses
- L15:772 weakly suppresses
- L14:2436 weakly excites
- L12:288 weakly suppresses
- L13:1826 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 是我们
- 녕
- zon
- 帮助企业
- anel
- restaur
- ocl
- alez
- 但现在
- selves
Suppresses
- Petersburg
- (le
- 游艇
- (head
- 不同的
- ACHER
- le
- dr
- Corinthians
- leve