'and' linking a role to a name
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'and' when it joins a person's job title or role to their name, as in 'physicist and best-selling author Brian Greene'. Turning it up did not produce anything obviously related to that pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
small schools in Michigan. HFLI developed a design thinking middle/high school curriculum. They have<|endoftext|>On Wednesday, protesters wrecked a statue of Philadelphia abolitionist and philanthropist Matthias Baldwin. They defaced the face of the statue, covered
-
urban oasis⏎Union Square began as part of Willowbrook, the John Donnell Federal-period estate, which he purchased in 1802 from Baltimore merchant and later Mayor Thorowgood Smith. In 1847, the Don
-
exhaust stream to generate a high energy steam cycle, which can then be used to help reduce the engine's fuel consumption.⏎Commenting on the projects, Project lead and Lecturer in the Department of Mechanical Engineering, Dr Copeland said: "These
-
.⏎Its analysis follows on from previous research by the think tank which found Greater Manchester has "lethal and illegal" levels of NO2 air pollution.⏎Report author and research fellow Jack Hunter said the well-being of people living in the North, and
-
increase calorie burn and reduce obesity risk in mice.⏎Apples Are Diverse⏎The apple is the most diverse food plant in the world. According to food journalist and apple expert Rowan Jacobsen, there used to be 16,0
-
create shade with a retractable awning, an umbrella or trees. "Look at the gifts and challenges that nature gives you in your own microclimate," architect and Natural Home columnist Carol Venolia says. "Working with nature is simple, but
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have I, but I, but I, but I, but I, but I, but I, but I, but I, but I, but I, but I, but I, but I, but I, but I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of Christ scenes for distribution by Christian publishers.⏎Head of Christ. This famous Protestant icon began as a charcoal sketch composed in 1924 for the official magazine of Sallman's denomination. A publishing firm affiliated with the Church of God
-
widely in India. This happened during WW II. In 1942 he was active in an underground movement against colonial rule. He also edited the literary magazine `Tomorrow` for some days.⏎`Kanthapura` is the first
-
carbon fuel use⏎Ottawa, Canada, May 5, 2012: “Climate campaigners at 350.org and their partner organizations are completely off base with Climate Impacts Day,” said Tom
-
an official under the czar’s vicegerent in Warsaw. Rzewuski edited the government newspaper Dziennik warszawski.⏎WORKSDziela, vols.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2947 strongly excites
- L13:1979 strongly excites
- L10:2935 strongly suppresses
- L6:1412 suppresses
- L12:2944 excites 'of' after a field, state or city noun
- L13:2403 excites
- L12:1662 suppresses
- L12:2989 suppresses
- L13:1420 suppresses
- L13:1140 excites
- L8:2006 excites
- L12:1670 excites
- L11:3062 suppresses
- L12:1811 suppresses
- L13:1384 excites
- L10:1627 excites
- L12:1393 excites
- L6:1639 excites
- L12:2599 excites
- L13:1376 excites
- L13:2311 suppresses
- L13:298 suppresses
- L13:838 suppresses
- L12:1184 excites
Feeds later layers
- L16:985 strongly suppresses
- L18:754 suppresses
- L19:761 suppresses
- L18:1678 suppresses
- L20:769 suppresses
- L15:1299 suppresses
- L20:331 excites
- L16:1599 suppresses
- L16:2067 suppresses
- L21:336 suppresses
- L17:255 suppresses
- L16:2178 suppresses
- L18:995 suppresses
- L17:775 suppresses
- L19:1934 suppresses
- L19:2576 suppresses
- L19:1017 suppresses
- L15:1497 suppresses
- L15:1381 suppresses
- L16:3012 suppresses
- L17:445 suppresses
- L18:92 suppresses
- L20:1112 suppresses
- L15:261 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- strup
- WithValue
- FileVersion
- Doug
- !⏎⏎⏎⏎
- ług
- 被执行
- !⏎⏎⏎⏎⏎⏎
- -blocking
- LIKE
Suppresses
- азв
- oyer
- eller
- igma
- eters
- qrt
- X
- isé
- "
- clair