"and" joining two parts of a name or phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word "and" when it links two parts of a title, name or description, such as "professor of global and environmental health". Turned up, the model got stuck repeating "I can't" or numbers, so the steering shows no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
as diabetes and obesity are closely related, our findings provide clear evidence that chronic exposure to air pollution increases the risk for developing obesity," said Duke University professor of global and environmental health, Junfeng Zhang. “If translated and verified in humans,
-
about WWII through the story of Anne Frank.⏎The back cover of the book carries an endorsement by the popular children’s author Jacqueline Wilson: “Exquisitely and imaginatively illustrated, this is a sensitive retelling of the moving story of Anne
-
?⏎In simple terms, cloud computing is a technology used for storing and accessing data, application and programs over the Internet. Cloud computing refers to the delivery of hosted and computing services including servers, storage, databases, networking, analytics, and intelligence over
-
do volunteer work during the course. Prerequisite: permission of instructor.⏎Course Description and Rationale:⏎A 2006 report by the Corporation for National and Community Service found that 3.3 million college students volunteered in 20
-
environment, and this work opens the door to new biological experiments," said Thomas V. O'Halloran, the study's senior author and the Charles E. and Emma H. Morrison Professor of Chemistry in the Weinberg College of Arts and Sciences
-
Harper (American, 1922–2007). Kids of all ages can enjoy playing the game and learning from the accompanying booklet about familiar and exotic creatures.⏎Sample booklet text:⏎Black bears usually live in forests and can climb
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I want to create a space for a research project in a remote research university in the Pacific Islands, research university in the Pacific Islands, research university in the research university in the research university in the research university in the research university in the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
that quantity. It states that the amount of the conserved quantity at a point or within a volume can only change by the amount of the quantity which flows in or out of the
-
redundancy, so if one drive breaks down, the data will be accessible from the remaining ones, and the second is improved performance as the input/output, or reading/writing operations will be distributed among different drives. There are different RAID types depending on
-
an interaction among 3 basic clusters of human traits:⏎• Above-average general &/or specific abilities⏎• High levels of task commitment (motivation)⏎• High
-
emia||1%||Ruled out|⏎How often do you get bacterial, viral, or fungal infections? For example, skin, ear, gastrointestinal, chest/respiratory, mouth, genitourinary. Symptoms usually include fever, pain
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:801 excites 'and' or 'or' joining list items
- L9:92 suppresses "and" or "or" joining two items
- L14:2276 excites opening bracket after a term or number
- L14:2823 excites
- L9:1820 excites
- L8:70 excites 'and' between stacked superlatives
- L9:2010 suppresses
- L14:2202 excites
- L13:131 excites 'and' joining parallel phrases
- L11:406 suppresses
- L10:2046 suppresses
- L14:706 excites
- L14:2627 excites 'or' or 'and' joining two items
- L14:1485 excites
- L14:745 suppresses
- L12:1786 excites
- L10:74 excites
- L12:2548 excites
- L9:1899 suppresses
- L4:57 suppresses
- L13:2356 excites
- L12:51 excites
- L6:427 suppresses
- L14:2865 suppresses
Feeds later layers
- L16:2580 excites 'and' linking food or health nouns
- L17:2274 excites
- L18:1625 excites
- L16:1937 excites 'and' joining two time or quantity ranges
- L18:1572 excites
- L18:1270 weakly excites
- L18:2354 weakly excites
- L18:2924 weakly excites
- L17:3025 weakly excites
- L23:1446 weakly excites
- L17:1802 weakly excites
- L20:2794 weakly excites
- L17:595 weakly excites
- L16:1462 weakly excites
- L21:409 weakly excites
- L21:197 weakly suppresses
- L18:1272 weakly suppresses
- L24:87 weakly excites
- L24:1294 weakly excites
- L19:1823 weakly excites 'and' inside organisation or paired names
- L17:48 weakly suppresses
- L24:1419 weakly excites
- L21:2225 weakly excites
- L18:1857 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- نك
- _hpp
- raries
- acies
- äft
- 況
- bish
- Addresses
- addresses
- 矧
Suppresses
- own
- Returns
- oge
- (<
- dae
- 喃
- licht
- dee
- льн
- 父子