'while' joining two clauses after a comma
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'while' when it comes after a comma and links two contrasting parts of a sentence. Turning it up did not give a clearly related change in the replies.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
⏎There are many types of batteries that you might use on your camper or RV, each with its advantages and disadvantages. Some are better suited for winter camping, while some are better for boondocking. It's important to know the type of
-
ticket, which can be done online or at any store that sells state-approved tickets. Ticket prices vary, but most are inexpensive. Some are scratch-off cards, while others are more expensive and require a computer to play. Some people also buy a
-
. Some foods can trigger inflammation or allergic reactions that can exacerbate the symptoms of it. Spicy foods, for example, can cause redness and flushing, while acidic foods can cause irritation and dryness. Dairy products and processed
-
During testing, control nets caught 125 green turtles, while the LED-lit nets ensnared just 62, with no negative
-
difference between the weather in the UK and southern Europe. In the UK we have on average about 1000+ hours of sunshine per year, where as in southern Europe it's more like 2,500-30
-
States, while the Navajo still suffer as one of the most impoverished communities in the country.⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if I can be as effective as the first one, and I can be as effective as the first one, and I can be as effective as the first one, and I can be as effective as the first one. Wait, but I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
that the camera could be plugged in directly in the wall outlet in the different measurement rooms.⏎The light weight and small size of the array ensured easy portability and also great flexibility in measurement positions. The camera could be set up on the tripod,
-
tests or grades or awards: curiosity is always a finer spur than rivalry. Nor do we diminish the students’ discoveries by reciting the famous names of those who
-
functions in the body for maintaining life. Diseases such as cancer are not only characterized by altered genes, but also by disturbed protein production. But how is protein production controlled?⏎Researchers of the
-
the amount of sodium balance. Orange keeps blood pressure correct by keeping sodium content normal. That is why anyone who has trouble with high or low
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:486 excites
- L0:1042 weakly suppresses "This" starting a labelled sentence
- L4:2835 weakly excites semicolons joining two clauses
- L1:1401 weakly suppresses
- L5:2359 weakly excites
- L2:1165 weakly excites
- L1:725 weakly suppresses "to" in "referred to"
- L0:565 weakly excites
- L2:305 weakly excites
- L3:1607 weakly suppresses
- L3:2140 weakly suppresses
- L0:2020 weakly excites
- L0:993 weakly suppresses
- L5:1124 weakly excites
- L2:1696 weakly suppresses
- L0:1075 weakly excites
- L5:2426 weakly suppresses
- L3:2123 weakly suppresses
- L2:144 weakly excites
- L3:1423 weakly suppresses
- L0:2533 weakly suppresses
- L3:1491 weakly suppresses
- L2:353 weakly excites
- L2:2656 weakly suppresses
Feeds later layers
- L9:1374 excites
- L15:2671 excites 'and' joining paired items
- L9:1089 excites
- L11:1242 excites
- L15:2310 excites
- L13:933 excites
- L18:2862 excites
- L17:2427 excites
- L12:972 excites
- L15:545 excites
- L9:1170 excites
- L13:125 excites
- L14:2150 excites
- L17:1499 weakly excites
- L12:1120 weakly excites
- L17:806 weakly suppresses
- L11:682 weakly excites gap before a second number
- L10:1898 weakly excites
- L18:2838 weakly excites
- L12:1378 weakly excites
- L8:70 weakly excites 'and' between stacked superlatives
- L12:141 weakly suppresses
- L22:1988 weakly suppresses "the" in "the more..., the more" phrases
- L18:1955 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rote
- itize
- rif
- owers
- -vertical
- ROID
- rowsers
- 另有
- MENT
- Vul
Suppresses
- 径
- ))->
- )object
- )).
- ęż
- ា
- .)
- ))*
- ))==
- vetica