'and' joining clauses after a comma
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'and' when it comes right after a comma and joins two full statements, such as 'help benefit individuals, and their families'. The negative side is weak and fires on 'too' after a comma. Turning it up gave wandering text that did not clearly show this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ressor framework will help guide management of stream fishes, and provide a better understanding of the mechanisms underlying responses of different species.<|endoftext|>The Liber
-
new light on our understanding of autism genetics. Importantly, these efforts are already sparking new actions that will help benefit individuals with autism, and their families, in the years to come.⏎April is World Autism Awareness Month,
-
physical ticket sales offices. Most states have laws regulating the operation of lotteries, and some even require retailers to be licensed before selling them.⏎The history of the lottery
-
test results to identify available treatment options. Artificial intelligence helps fund managers identify opportunities by utilizing data to evaluate statistical models and macroeconomic, and geographical trends.⏎Judges and lawyers can benefit from AI’s ability to analyze information
-
Black and white illustrations are essential as a newborn’s retina can only distinguish between light and dark contrasts. Research shows that black and white images promote optic nerve growth, and help the visual part of a baby’s brain to thrive and develop by leaps and
-
of time and creating high operations costs. Terraform is an effective solution to this issue, allowing administrators to rapidly deploy and reconfigure infrastructure all from one place, and all at the same time. It is this ability especially that makes Terraform so
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I don't know how to be the right one, but I don't know how to be the right one." — That is a very good word, but I don't know how to be the right one." — That is a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
baby warm after birth," said a CHW. "Embracing a newborn against the mother's warm skin is so simple, and the mothers like it, too."⏎With nearly nine out of 10 births in Afghanistan still occurring in the
-
replied “don’t know.”⏎As the lives of English-language learners change because of attending U.S. schools and interacting with other children in this country, so, too<|endoftext|>There has been a catastrophic event in 2010 in the Gulf
-
long shadows produced by the low-angle sun to lead the viewer's eye into the photo.⏎Shadows extending toward the camera can create leading lines, too.⏎Shadows are more than just black blobs that mimic the shapes of things casting
-
from proteins, too.⏎In a healthy body, carbs are all broken down into glucose. That glucose
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:27 suppresses
- L0:313 weakly suppresses "and" joining paired nouns
- L0:1224 weakly suppresses
- L0:1301 weakly suppresses
- L0:178 weakly suppresses
- L0:97 weakly excites
- L0:385 weakly excites
- L0:251 weakly suppresses
- L0:1909 weakly excites
- L0:838 weakly suppresses
- L0:274 weakly excites
- L0:1624 weakly suppresses
- L0:1514 weakly suppresses
- L0:1259 weakly excites
- L0:1560 weakly excites
- L0:271 weakly excites
- L0:692 weakly suppresses
- L0:1335 weakly excites
- L0:2921 weakly suppresses
- L0:2659 weakly excites
- L0:2907 weakly excites
- L0:1493 weakly suppresses
- L0:386 weakly suppresses
- L0:1097 weakly suppresses
Feeds later layers
- L6:1349 weakly suppresses
- L4:1572 weakly suppresses
- L19:851 weakly excites comma inside numbers with thousands
- L23:676 weakly suppresses the 'm' in a.m. and p.m
- L4:1351 weakly suppresses
- L6:798 weakly excites
- L6:1978 weakly suppresses
- L7:498 weakly suppresses
- L4:1642 weakly suppresses
- L21:1947 weakly suppresses
- L10:2804 weakly excites
- L13:609 weakly suppresses
- L5:394 weakly suppresses
- L23:199 weakly suppresses
- L23:993 weakly excites
- L24:880 weakly suppresses
- L3:621 weakly suppresses
- L5:668 weakly suppresses
- L23:2871 weakly suppresses
- L2:428 weakly suppresses
- L20:2717 weakly suppresses
- L4:1256 weakly suppresses
- L12:1235 weakly suppresses commas inside numbers and lists
- L13:1436 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- undler
- ersonic
- recommend
- ировки
- …⏎⏎⏎
- érique
- antino
- …⏎⏎
- 退税
- ATERIAL
Suppresses
- казал
- ffield
- ᴗ
- ;"><
- IRTH
- eresa
- 膝
- her
- irth
- �