line break after a section heading
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the line break that comes right after a short heading, like 'Some shocking statistics' or 'Flavors Start in the Womb', just before the body text starts. Turning it up made the model's output drift into long, repetitive or unfocused text, so the steering result does not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
,” said Long, who formerly worked for Diné Citizens Against Ruining Our Environment, a Navajo environmental-activist organization.⏎The fossil fuel of the future⏎Dust billows at the Navajo Mine as a dragline excavator sco
-
disparities for African Americans as well as many other groups, highlights areas where some progress has been made, and lays out the paths toward significant solutions.⏎Some shocking statistics⏎These statistics provide some enlightening examples of what the report found — and the discrepancies
-
feeding advocates insist that flavors in breast milk go beyond a simple enjoyment for the infant -- it might be important for health too.⏎Flavors Start in the Womb⏎"The fact that the flavor is passed to the<|endoftext|>Masdar City was a project
-
such as Carrier parts, and how to maintain and replace them when necessary. This guide provides a comprehensive look into the world of HVAC parts.⏎Understanding Different HVAC Components⏎HVAC systems consist of several key components, each with a specific function. The
-
iev collection of Kubotas. Jacqueline Atkin, a North Carolina-based art curator and historian, is in charge of the whole collection.⏎A unique piece of art⏎The entire exhibit is composed of different pieces. While each piece aims to depict a
-
). "Childhood cancer patients and families shouldn't have to delay treatment because hospitals and cancer treatment centers ran out of medication."⏎The Fight Against Childhood Cancer Continues⏎The NCCS has provided assistance to more than 30,00
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I am" and "I am, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
puzzle ideas put out there by Quora members.⏎Practical Applications in the Classroom⏎- A teacher-created Escape room can provide a valuable opportunity for students to<|endoftext|>Imagine a star (like our sun) wandering close to a supermassive black hole
-
particularly humanities classrooms. I had a lot to say, and, since I’m often asked “Why clickers?” I thought I would reproduce my comments here.⏎I’m a little late to this discussion, having just found it on a Google blog
-
hole⏎Answerwaist coat tail gate way side arm pit fall out put down cast off spring time line man hole⏎See another brain teaser just like this one...⏎Or, just get a random brain teaser⏎If you become a registered user you
-
resulted in similar findings. Thus, methods are defined for improving neural stem cell grafting, survival and analysis of in vivo findings.⏎21 Related JoVE Articles!⏎A Radio-telemetric System to Monitor Cardiovascular Function in Rats with Sp
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:784 suppresses
- L9:2729 suppresses
- L10:1136 suppresses
- L10:494 suppresses
- L9:542 excites
- L10:928 suppresses
- L10:1516 excites
- L11:1614 excites
- L9:2447 weakly excites
- L9:455 weakly suppresses
- L7:1729 weakly suppresses
- L10:1580 weakly suppresses
- L10:1340 weakly excites
- L8:422 weakly suppresses
- L8:708 weakly excites
- L9:1039 weakly excites
- L10:1244 weakly excites
- L10:2801 weakly excites
- L8:2976 weakly excites
- L8:1885 weakly excites
- L10:44 weakly suppresses
- L4:183 weakly excites
- L8:807 weakly excites
- L9:582 weakly excites
Feeds later layers
- L14:135 suppresses
- L14:2189 excites
- L16:818 excites
- L26:373 suppresses
- L18:412 excites
- L15:512 suppresses
- L14:2400 excites
- L14:1132 excites
- L14:241 excites
- L14:2061 excites
- L13:626 excites
- L16:1401 excites full stop ending an encyclopedia-style opening sentence
- L13:1498 weakly excites end of a document boundary
- L15:2047 weakly suppresses
- L17:1204 weakly excites
- L13:1103 weakly suppresses
- L17:1930 weakly excites
- L15:2293 weakly excites
- L13:52 weakly suppresses
- L19:2931 weakly excites
- L17:243 weakly suppresses
- L15:1956 weakly excites
- L16:1545 weakly excites
- L16:348 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- imen
- imens
- serter
- imer
- inker
- TI
- orer
- concentr
- PEND
- TI
Suppresses
- ฆ
- сан
- `.⏎⏎
- [];⏎⏎
- 参
- StatusLabel
- eco
- modelName
- ”.⏎⏎
- ”。⏎⏎