word before a noun naming people or a role
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word just before a noun that names a group of people or a role, such as 'six crews', 'people that coach' or 'people with disabilities'. Turning it up did not make the written text show a clear pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to be launched to test the Kontakt lunar rendezvous/docking system. During the Salyut 1 mission, in June 1971, six crews were identified and assigned to specific Soyuz spacecraft serial numbers for these tests. These
-
to another client, think twice before parting with your economic rights.<|endoftext|>The USA Basketball Player Development Curriculum has been established to guide players, and the people that coach them, through a level-appropriate system of basketball development. Using scientific guiding principles
-
and put his scalp on display for money.⏎In 1900, Thompson sent the scalp back to the Nebraska doctor who tried to reaffix it, who, in turn, donated it to the public library. The scalp remained on display
-
Porcelain⏎Process – Raw Porcelain is rolled to create the tile, each letter is hand imprinted into the clay, which is then fired in the potter’s kiln at 1230 degrees celsius, making it solid
-
a moon base, a representative wouldn’t confirm or deny the plans. “We are pursuing a range of possible destinations on route to an eventual trip to Mars,” they explained, but admitted that a lunar waypoint would be “in the range of possibilities
-
Each season, natural<|endoftext|>This brochure is one response to a need identified by people with disabilities. The way we portray people with disabilities and our attitudes toward them are critical
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I am 25 years old, and I have been thinking about it." This is the case of the movie "The Granger" (2005) who is 25, and the movie "The Granger
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
their hands. As they develop control of their body, they may become hyperactive. Always on the move, these students must find physically active careers⏎Logical – those who excel in problem-solving & number manipulation. They may be easily frustrated with anything
-
glance, a relatively simple question with a quick answer: Hindus speak for Hindus. If proof is needed, then one could commission a poll to ask a cross-section of Hindus who speaks for them. But a series of articles on this very question appearing
-
are called to be servants. Scriptures seem to invite that identity and it makes sense: Love your neighbor as yourself. Serve others as Jesus served. Let the greatest among you be a servant.⏎Remember, though, that many biblical images for “serv
-
Since ECT is well-known for having negative effects on recall in general — that’s why it’s reserved for only the most intractable cases— the researchers wanted to see if it might only disrupt a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:1248 strongly excites
- L9:782 strongly suppresses
- L9:205 suppresses
- L7:360 suppresses
- L9:273 suppresses
- L9:3023 suppresses
- L4:885 excites
- L7:180 excites
- L9:1948 excites
- L7:743 suppresses
- L8:1751 excites
- L7:2714 excites
- L6:214 suppresses
- L7:2753 suppresses
- L9:1562 excites 'by' before a byline or agent
- L5:17 suppresses
- L6:699 excites
- L9:1221 suppresses
- L9:1830 excites
- L9:1652 suppresses
- L6:563 excites
- L6:2756 excites
- L5:2728 excites
- L6:682 excites
Feeds later layers
- L16:1054 suppresses
- L15:1244 suppresses
- L11:1741 suppresses
- L16:2215 suppresses
- L26:1294 suppresses
- L12:495 suppresses
- L16:1438 suppresses
- L12:2415 suppresses
- L12:1679 suppresses
- L22:1997 suppresses
- L11:333 suppresses
- L13:2765 suppresses
- L12:1479 suppresses
- L12:2887 suppresses
- L11:1167 suppresses
- L11:1512 suppresses
- L22:396 suppresses
- L22:545 suppresses
- L11:978 suppresses
- L16:1894 excites
- L16:2627 suppresses
- L12:755 suppresses
- L11:1844 suppresses
- L11:1211 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- erable
- ibur
- itemap
- Magnum
- rake
- forks
- ikal
- Jarvis
- rary
- metast
Suppresses
- who
- who
- ptide
- whom
- 에게
- 群体
- 人群中
- 的目光
- 目光
- 一人