'prone to' and similar phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron often lights up on the words 'to' after 'prone' (as in 'prone to errors'), and on a few other unrelated words. When it was turned up, the written text did not clearly change in a way that relates to this.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
California is at about 48%.⏎The Garbage Crisis⏎The world has changed a lot in the past century. From individually packaged food servings to disposable diapers, more garbage is generated now than ever before. The average American discards seven
-
nutrient depletion and to increase organic matter, which makes it less prone to drought, flooding and water-logging. The project has helped reduce pressure on the
-
8, in the Nihon Shoki 日本書紀 (720) 9 and in the Hizen-no-kuni fudoki 肥前國風土記 (first part of the 8th century)
-
or the expression.⏎from WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.⏎- adj. somewhat ill or prone to illness⏎- adj. having or rising to a peak⏎According to the Twitter
-
affected by electrical noise emitted by gadgets like smartphones, TVs, computers, even vacuum cleaners and hairdryers, AM signals are prone to distortion and crackling.⏎That crackle apparently just doesn’t fly with luxury auto
-
,570 and $65,260 a year.⏎Salary by Employment Sector⏎As of 2011, the highest-paid electricians were those who taught at business schools. These workers earned an average of $7
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am going to take the first step. I am going to take the first step. I am going to take the first step. I am going to take the first step. I am going to take the first step. I am going
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
only declared as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++.⏎/* memchr example */⏎int main ()⏎char * pch;⏎char str = "Example string";⏎pch
-
full list of Biblical Festivals.⏎Question: How many days should Passover be observed? Please include any references to your response that is indicated in the Torah.⏎Answer: Before I answer your question, as a word of background, you need to
-
. Numerous ancient Greeks believed that Iris served as a conduit between Earth and the divine, metaphorically represented
-
, the two advocates changed the course of American history.<|endoftext|>Question: What is it significance of the date passover falls on and the phase of the moon?⏎Answer: The date on which to observe Passover comes from the Torah -- it is
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L22:2664 weakly suppresses
- L12:2382 weakly suppresses
- L2:2627 weakly excites
- L18:1357 weakly excites
- L3:1030 weakly suppresses
- L14:685 weakly suppresses
- L10:352 weakly excites
- L16:2165 weakly excites
- L11:590 weakly suppresses
- L13:946 weakly suppresses
- L18:201 weakly excites
- L4:2800 weakly excites
- L13:2570 weakly suppresses
- L19:2093 weakly suppresses
- L1:892 weakly excites
- L6:1901 weakly suppresses
- L14:1157 weakly suppresses
- L10:1520 weakly excites
- L16:779 weakly excites
- L19:762 weakly suppresses
- L7:1886 weakly suppresses
- L24:562 weakly excites
- L9:200 weakly excites
- L6:2952 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- burg
- aleza
- iteur
- rome
- ertools
- uating
- idel
- minster
- cape
- ittel
Suppresses
- annot
- alcon
- queried
- searched
- Pag
- annotated
- ouples
- ancode
- sad
- chast