end of document boundaries
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the invisible marker the model uses to show that one web page or document has ended and another begins. It is a weak signal compared with the strongest neurons. Steering it did not change the text in a recognisable way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of qualified health providers with questions you may have regarding medical conditions.<|endoftext|>The Amendment Process and the African American Fight for Representation and Equality⏎Black History Month
-
one thing which was enjoyable and fascinating on your youngster, however you're fearful about whether or not the fabric will really enhance your kid's long-term college efficiency.<|endoftext|>“When Paroh will say to you, “Provide for yourself a mofait
-
of the capital.⏎The contents of this article is licensed from www.wikipedia.org under the GNU Free Documentation License. Click here to see the transparent copy and copyright details<|endoftext|>What is Celiac / Coeliac Disease?Tweet⏎What is Celiac Disease
-
|⏎|Launched:||25 October 1941|⏎|Commissioned:||28 April 1942|⏎|Decommissioned:||28 June 1945|⏎|Renamed:
-
positives can be reduced by focusing on high-risk patients and using regular instead of digital mammogram's.⏎All content © Copyright 2000 - 2013 WorldNow and WXOW. All Rights Reserved.⏎Persons with disabilities who
-
also hope to take measurements<|endoftext|>RWJF Priority: Use pricing strategies—both incentives and disincentives—to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if the otherworldly beings who are more advanced than the ones who have been studying the stars, and who have been fascinated with the concept of time, and the concept of the stars? What is the way to understand the balance of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
preserving their industrial past. This was one of our favorite areas to explore.⏎9 thoughts on “The Lachine Canal & Canada Malting Silos”⏎The place looks good
-
become overweight and obese, we must attack the problem from all angles. Maybe the day will come when gyms are as easily found as fast food restaurants."⏎More information: Beat Schuler,
-
human experience. Her works invite readers to contemplate the beauty of the natural world and their place in it, encouraging a deeper understanding of oneself and the surrounding environment.⏎Q2: How does Mary<|endoftext|>Unified Modeling Language⏎<language> (UML
-
Front Ecol Environ, http://www.joeroman.com/wordpress/wp-content/uploads/2014/09/roman-frontiers.pdf.<|endoftext|>Oil & Natural Gas Projects⏎Transmission, Distribution, & Refining⏎Mult
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:375 suppresses
- L7:332 suppresses
- L8:1090 excites
- L10:283 suppresses
- L9:690 excites
- L11:379 excites
- L10:1038 excites
- L7:503 excites
- L11:1377 excites
- L10:2821 excites
- L8:362 excites unclear: evaluative or explanatory phrase words
- L10:2475 excites
- L9:1459 excites
- L8:848 weakly excites
- L11:2715 weakly suppresses end of a document
- L7:542 weakly suppresses
- L10:928 weakly suppresses
- L7:301 weakly suppresses
- L8:385 weakly excites
- L8:1193 weakly excites
- L11:440 weakly suppresses
- L11:629 weakly excites
- L10:1298 weakly excites
- L7:567 weakly suppresses
Feeds later layers
- L14:2827 suppresses
- L13:969 excites
- L14:2045 suppresses
- L14:571 excites
- L14:3011 suppresses
- L13:34 excites
- L15:2990 excites
- L14:1069 suppresses
- L13:1358 suppresses
- L13:2182 excites
- L13:1201 excites
- L18:2322 suppresses end-of-text token after a finished passage
- L14:2803 suppresses
- L14:2113 excites
- L16:2476 excites
- L17:1980 suppresses
- L14:1574 suppresses
- L14:889 suppresses
- L15:457 excites
- L13:381 excites
- L14:1628 weakly suppresses
- L13:1589 weakly suppresses
- L14:2367 weakly excites
- L17:397 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- stad
- -now
- elta
- (Local
- 惧
- Lotto
- แหละ
- combined
- ora
- laat
Suppresses
- rint
- ior
- .SetString
- ure
- aki
- )⏎⏎⏎
- uggestions
- idia
- :⏎⏎⏎
- íd