"but" after a concession
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on "but" when it follows a difficulty or admission and turns to a positive point, such as "it may sound like a pipedream but" or "not easy, but". It is quiet on "even" in the opposite sense. Turning it up made the model write loose, unrelated sentences rather than showing this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
that you<|endoftext|>America's first industry was neither textiles, nor iron, nor arms, but rather glassmaking. Early manufacturing attempts met with hardships and often failure, but in time the business of glassmaking and the demand for glass products became an important
-
for them to make new friends, master the teaching material, and be successful in any extracurricular activity. That, of course, is not easy, but fortunately, there are strategies to help one build confidence both in
-
even hear a simple word like "mama," "dada," or "ball." You baby isn't able to use these words with real meaning yet – but she's working on it.⏎Your baby's beginning to understand how objects relate to
-
the answer to the low cost decarbonisation of heat puzzle, or a flight of fancy? Well, it may sound like a pipedream (sorry!) but try telling that to the 20 members of the Young Persons Network who visited
-
could help treat cancer that already has developed. None have been approved for use yet, but a number of experimental therapeutic vaccines have shown promise at helping the body recognize cancer cells
-
a complex dilemma leaves you uncertain, there are some tools that can help you work your way to a good decision. They can’t tell you what to do, but they can certainly help you figure it out for yourself.⏎When I’m forced to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have no, and I have not, all of the above, given you a mirror, and I have only just learned something to be a mirror to you, and I am 182, 13.5 weeks
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.)⏎It is harder to sort out the chronological data for the period of the kings (between 1000 and 500 B.C.), and even more difficult to be certain about the period between the exile and the New Testament (
-
DPFs) and a new generation of substrates designed for diesel engines.⏎An Enabling TechnologyDPFs based on Corning's technology aren't new; in fact, Corning first introduced the cellular ceramic particulate filter to remove soot from
-
and UNICEF in 1995 and adopted in over 90 countries and territories. However, few countries have implemented it at scale, and even fewer have effectively adapted their education systems to include health promotion. The new global standards
-
offset environmental gains. If a family buys a fuel-efficient vehicle but chooses to drive more miles than they previously did, there is no gain for the environment. Also, while the average U.S. household size is decreasing, Americans are generally choosing to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:1427 suppresses
- L11:2703 suppresses
- L10:2215 weakly suppresses
- L11:1868 weakly excites
- L6:1561 weakly suppresses
- L8:384 weakly suppresses
- L11:2992 weakly excites
- L7:348 weakly suppresses
- L1:549 weakly excites "g" in "e.g." examples
- L9:1303 weakly suppresses
- L8:1920 weakly suppresses
- L11:1372 weakly suppresses
- L10:2937 weakly excites
- L9:2646 weakly excites
- L10:1232 weakly excites
- L7:1490 weakly suppresses
- L3:1906 weakly suppresses
- L10:2244 weakly suppresses
- L8:2609 weakly suppresses
- L10:2304 weakly suppresses
- L3:594 weakly suppresses
- L4:2264 weakly suppresses
- L7:1586 weakly suppresses
- L0:2457 weakly excites
Feeds later layers
- L13:642 excites
- L18:1369 suppresses
- L22:1437 suppresses
- L20:1960 suppresses
- L19:826 excites
- L14:111 excites
- L16:1747 suppresses
- L17:847 suppresses
- L17:2025 suppresses
- L15:1725 suppresses
- L16:2849 suppresses
- L23:391 suppresses
- L16:295 excites
- L15:1484 suppresses
- L15:1157 suppresses
- L22:289 excites
- L15:1669 suppresses
- L25:124 suppresses
- L13:1447 suppresses
- L13:587 excites
- L13:924 suppresses
- L13:678 excites
- L17:778 excites
- L21:1045 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 准时
- playable
- tempts
- 맞
- raries
- fortunately
- nonetheless
- erto
- -winning
- etection
Suppresses
- 匮
- inconsist
- 凋
- 得不到
- aside
- ath
- 不好
- bbe
- ôme
- lacked