word after a question starter
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word right after a question starter, such as the "does" in "What does" or the "many" in "How many", especially in lists of study questions. Turning it up made the output wander into unrelated text rather than anything clearly about questions.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
for no longer than one to two days in the refrigerator.⏎What does vinegar do to chicken?⏎What Does Apple Cider Vinegar Do for Chickens
-
?⏎(b) In what quantity?⏎(c) At what price?⏎(d) When do they want (it)?⏎(e) What kind of
-
⏎Write a code that will follow the equation y = x * (x + x) * x.⏎Mile to Kilometer⏎Given A4 sizes find A3's long side⏎Polygon Interior Angle Sum⏎Bit to Gigabyte⏎Find
-
sold 830 newspapers. His brother James sold 177 fewer newspapers than Ben.⏎(a) How many newspapers did James sell?⏎(b) How many newspapers did they sell altogether?⏎In early 2-step problems, the textbook asks
-
a very low rank. When the school superintendent looked at the results, he immediately identified the teacher–her husband had died during the second year of rankings.⏎What does this anecdote illustrate? For starters, that value-added assessments can
-
could be a resource for information you are looking for, in the same sense that resources for getting water might include a lake, a stream or a well.⏎What does "documenting resources" mean?⏎Documenting a resource means putting all the right
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 20-year-old, 1000000 total cases. I have a sample mean of 1000000 for both, and I have n=100000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
photographs and a short<|endoftext|>NASA Announces Asteroid Naming Contest for Students⏎October 18, 2012⏎Students worldwide have an opportunity to name an asteroid from which an upcoming NASA mission will return the first samples to Earth.⏎
-
to balance this equaliser? You can put more⏎than one weight on a hook.⏎What is the greatest number of counters you can place on the grid below without four of them lying at the corners of a square?⏎How many different triangles can
-
and delayed the release? Provide reasons for your decision.⏎You must first post your answer(s) before you can
-
Land."⏎And for background on the coal industry that's pushing this bad idea, download our report "The Dirty Truth About Coal: Why Yesterday's Technology Should Not Be Part of Tomorrow's Energy Future."⏎Make Mine Illegal⏎The Coeur d'
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:656 suppresses
- L7:658 excites
- L7:407 suppresses
- L7:37 suppresses
- L7:336 excites
- L7:664 excites
- L7:1183 suppresses
- L7:931 excites
- L5:596 excites
- L7:314 suppresses
- L7:909 suppresses
- L7:1454 suppresses
- L5:144 suppresses
- L5:768 suppresses
- L7:469 suppresses
- L3:488 excites
- L7:946 suppresses
- L7:760 suppresses
- L4:63 excites
- L5:458 excites
- L3:814 suppresses
- L6:269 excites the word role after play or a potential role
- L5:397 suppresses
- L7:1574 excites
Feeds later layers
- L10:867 strongly excites
- L11:3069 excites
- L9:166 suppresses
- L9:313 excites
- L11:1648 suppresses
- L11:275 excites
- L12:1186 excites
- L10:1330 excites
- L10:1325 suppresses
- L12:1938 suppresses
- L12:1586 suppresses
- L12:2946 excites
- L10:889 suppresses
- L13:2349 excites
- L15:1594 excites
- L12:793 excites
- L11:143 excites
- L14:922 suppresses
- L11:200 weakly suppresses
- L10:2247 weakly excites
- L15:1513 weakly excites
- L9:637 weakly suppresses
- L12:1092 weakly excites
- L13:1902 weakly excites unclear: text just before document breaks
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 而言
- 侧结构性
- 而
- ijkl
- WEEN
- CardContent
- ег
- *size
- 康
- 谢
Suppresses
- منظ
- ultipart
- Millions
- dam
- athing
- ulpt
- athed
- Projects
- athi
- Boys