'to' after 'reason' or 'how and when'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'to' right after phrases like 'no reason to' or 'learn how and when to', where an infinitive is about to follow. Turning it up gave text that did not clearly change theme, and turning it down produced number lists and quiz-style text, so the link to the trigger is weak.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
12.054 of the Texas Property Code governs judicial<|endoftext|>Adjustment to college life after school is always a challenge for young adults. One reason to be unsuccessful in navigating stress, depression, anxiety during college days is that the maturity
-
of the planet relies on these cloud fortresses, and will do so even more in years to come. Remarkable as the cloud is, there is no reason to think it is anywhere near completion. The generation of data and the need for its
-
. (June 2009) (Learn how and when to remove this template message)|⏎The Central Business District as seen from the top of
-
., a client and server)⏎talking to one another, we have only one channel of communication. Clearly,⏎we need more than two entities. It seems unreasonable to require a hundred⏎Looking into millennia of human uses of trust, we realize that
-
glucagon emergency kits for home and school.<|endoftext|>|This article needs additional citations for verification. (July 2012) (Learn how and when to remove this template message)|⏎Sendust is a magnetic metal powder that was invented
-
people reading this have reached an age where fat either is, or may potentially be, a problem, it’s worth stating that there’s actually no biologic reason to get f
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of 3D views in a 3D view is a question of understanding the relationship of the three-dimensional views within a 3D view, and the problem is to find the best understanding of the three-dimensional views within a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, England's Farnborough Airshow. Click here to read an MIT News Office story on the glider, here to read about the award, and here to check out the project homepage.<|endoftext|>Since 1993, RAN
-
release and endoscopic surgery.⏎(Click Carpal Tunnel Syndrome to learn more, including what causes the condition and who is most at risk for it. You can also click any of the links in the box to the right for specific information.)<|endoftext|>
-
by Dr Gemma Catney, Professor Richard Wright, and Professor Mark Ellis. The original article, posted in Geography Directions, can be accessed here. You can also read the full article published in Transactions of the Institute of British Geographers here.⏎
-
world of nature. We believe that children who learn to love our Earth⏎today will protect it tomorrow.⏎On our web site, you can look at our books and find out how to order them. In⏎you¡¯ll find fascinating information
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:592 excites
- L15:2379 suppresses
- L20:1015 excites
- L20:2262 excites
- L17:2643 excites
- L19:730 excites
- L20:386 excites
- L19:1418 excites
- L19:2879 suppresses
- L16:2107 suppresses
- L20:2725 excites
- L19:1294 excites
- L20:2095 suppresses
- L19:2821 excites
- L19:2460 suppresses
- L19:385 suppresses
- L18:700 excites
- L20:1054 suppresses
- L18:1898 excites
- L20:1368 suppresses
- L16:1072 excites
- L20:1124 suppresses
- L5:1000 suppresses
- L20:1613 excites
Feeds later layers
- L23:966 suppresses
- L23:2471 suppresses
- L22:1896 suppresses
- L22:1618 excites
- L22:2102 suppresses
- L22:1991 excites
- L24:1996 excites
- L22:2801 suppresses
- L22:2841 suppresses
- L22:2306 suppresses obedience and submission
- L23:1827 suppresses
- L22:2323 excites
- L23:1379 suppresses
- L25:640 excites
- L23:2257 suppresses
- L27:1274 excites
- L22:952 excites
- L25:958 excites
- L23:1454 weakly suppresses
- L25:1483 weakly suppresses
- L24:442 weakly excites
- L24:963 weakly excites
- L22:593 weakly suppresses
- L25:800 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 提供
- offering
- providing
- offer
- 给出
- Provide
- provide
- 推送
- 给她
- Offering
Suppresses
- 服从
- choose
- utsche
- stances
- 听
- choosing
- 知道了
- choose
- participated
- 接过