'because' and 'that' after a reason
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'because' (or 'that') when it introduces a reason, as in 'the reason is because...'. Turning it up or down did not clearly change the writing in a way that matches this.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
decision affects most of the outcome in this play. “To turn your households’ rancor to pure love.” Now the feuding families eventually stopped but only because Romeo and Juliet died. This was mainly because of the Friar.⏎The Cap
-
his own for three hours, and until he got back she was confused about why he didn’t come when she called him.⏎Why would no one be puzzled? Because there’s one he and there’s one she and life is pronominally simple
-
of a ‘slowing’ of the metabolism is that older people burn fewer calories on average per kilo of bodyweight than do younger people. But that’s because their lean body mass is less.⏎In a book called Biomarkers, authors William
-
pe climates, usually border desert climates. In both climate groups, the temperature change between day and night is considerable. One reason for the wide swings in temperature is that the skies are clear and the air is dry. Clouds would reflect much of
-
0 minutes – it’s essentially moving in a straight line. The reason the path is all bendy is because Swift itself is in motion! Swift orbits the Earth, circling us once every
-
. At the end of the decade, the median American family had 30% more purchasing power than at the beginning. Inflation was minimal, in part because of Eisenhower’s efforts to balance the federal budget. Unemployment remained low, about
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: A person's work is more likely to be in alignment with the career of someone they know. This is a hint to the person with the answer. So, if a person's work is more likely to be in alignment with the career of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
(in the United States) 911 immediately. Always seek the advice of your doctor before starting or changing treatment. Medical professionals who provide responses to health-related
-
The EPA conducted tests and found that architectural coatings were a large contributing factor to this sort of damage, and that it was therefore essential to limit the amount of emissions from this source.⏎VOC regulations also strive to protect the water
-
quotes above come from a June 2016 piece he penned on LinkedIn, which ended “
-
which could negate the effects of gravity. However, as sometimes happens in the Toobworld Dynamic, its use in the 2010 TV movie based on that novel was not its first mention in the TV Universe.⏎By the 2
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:2299 excites
- L6:2754 excites
- L4:1787 suppresses
- L6:2143 excites
- L3:878 excites 'of' after 'Because'
- L7:989 suppresses
- L6:2134 excites
- L6:1883 suppresses
- L6:2119 suppresses
- L6:701 suppresses
- L6:1129 excites
- L6:2303 suppresses
- L6:2235 weakly excites
- L6:1313 weakly suppresses
- L4:1013 weakly suppresses
- L1:2745 weakly suppresses
- L0:2563 weakly suppresses
- L6:275 weakly excites
- L6:523 weakly excites
- L5:1729 weakly excites
- L4:2834 weakly excites
- L7:530 weakly suppresses
- L8:984 weakly excites
- L8:2564 weakly excites
Feeds later layers
- L15:1987 excites
- L12:1137 excites
- L11:1569 suppresses
- L18:2841 excites
- L12:1522 excites comma after a 'before...' clause
- L10:1904 suppresses
- L12:2402 excites
- L14:1478 excites
- L13:481 excites 'because' introducing a reason
- L16:1287 weakly suppresses
- L12:2340 weakly excites
- L15:2443 weakly excites
- L12:1331 weakly suppresses
- L10:1344 weakly excites
- L24:2492 weakly excites
- L19:2707 weakly excites
- L18:2646 weakly excites
- L16:1913 weakly excites
- L11:1986 weakly excites
- L15:513 weakly excites
- L10:1855 weakly excites
- L16:2630 weakly excites
- L27:1386 weakly suppresses
- L22:1336 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 病因
- -condition
- 浏览器
- 什么原因
- condition
- condition
- rl
- agger
- due
- 빈
Suppresses
- phet
- gehören
- chia
- gehört
- hower
- ergus
- ники
- heten
- .omg
- **)&