end of a web document
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the spot where a web page or document ends and an unrelated one could begin, marked by the end of text token. Turning it down made the model ramble and repeat itself, and turning it up gave off-topic text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
|⏎|Required to build||libstdc++|⏎|Required to build||fortran|⏎This entry (in part or in whole) was last reviewed on 4 February 2012.⏎Permission is granted to copy, distribute
-
speech; the second deals with the relative clause and sentence combining by addition; and the third section covers the verbals.⏎Includes a test/answer key booklet.<|endoftext|>extinction coefficient - (Mar/17/2006 )⏎how
-
Education.⏎A minimum resolution of 1024 x 768 is recommended.⏎To access this document off-line, you can print this document.<|endoftext|>Maybe you’ve had raw milk, seen it for sale in your local health food
-
of tissue are taken for further analysis. It may also be necessary to retain entire organs for a more detailed examination. This is strictly limited to cases where such retention<|endoftext|>Published August 30, 2004⏎by Diane Pub Co
-
20 years, and the best bird of the count has been identified on LyondellBasell property several years.”⏎Michael Kennedy worked for LyondellBas<|endoftext|>Discover the cosmos! Each day a different image or photograph of our fascinating universe is
-
to the youngest visitors to the museum. They can practice the alphabet as they travel from letter to letter in the maze. An open area at the front with toddler<|endoftext|>Mental Health and Wellbeing for Students⏎Moat gives students a platform in
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number, 331, is the number that is in the day time is in the time of "the time is 331 on the time, that's a person is time, is, which is the time,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ation/the-omnivores-delusion-against-the-agri-intellectuals/⏎Leave a ReplyWant to join the discussion?⏎Feel free to contribute!<|endoftext|>Tree Roots Can Wreak Havoc on Pipes — How to Best Prevent Pipe
-
trip the circuit breaker.⏎Email Based, Online Homework Assignment Help in Classification Of Relays⏎Transtutors is the best place to get answers to all your doubts regarding classification of relays with examples. Transtutors has a vast panel of experienced
-
, title, abstract, bibliographic or download information, contact: (Michael McNulty)⏎If references are entirely missing, you can add them using this form.<|endoftext|>Farmers fight drought with move to digital age⏎21 August 20
-
These include physical features of the<|endoftext|>Learn vocabulary, terms, and more with flashcards, games, and other study tools. Optional activities are designed to enhance understanding andor to provide additional practice. Each
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:2359 excites
- L13:1084 suppresses
- L14:1736 excites
- L12:1648 suppresses
- L13:2354 excites
- L13:3045 suppresses
- L12:2466 excites
- L13:2027 suppresses
- L14:2164 suppresses
- L12:2323 excites
- L11:122 suppresses
- L14:80 suppresses
- L12:2873 excites
- L13:2946 excites
- L13:2147 suppresses
- L12:2943 excites
- L14:1042 suppresses
- L12:2684 excites
- L14:1641 suppresses
- L14:2941 excites
- L13:2014 suppresses
- L9:2085 suppresses
- L11:1675 suppresses
- L12:2668 suppresses
Feeds later layers
- L16:248 suppresses
- L17:892 excites
- L16:2477 suppresses
- L16:200 suppresses
- L16:1543 excites
- L16:1262 suppresses
- L20:543 excites
- L27:828 excites
- L19:929 excites
- L22:157 excites
- L18:129 suppresses
- L18:45 suppresses
- L19:229 suppresses
- L21:105 excites
- L23:206 excites
- L20:312 excites
- L27:609 excites
- L27:856 excites
- L20:33 suppresses
- L24:226 excites
- L16:2151 weakly excites
- L21:12 weakly suppresses
- L19:251 weakly excites
- L27:581 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- :",⏎
- *)⏎⏎
- )")⏎⏎
- ++)⏎
- /"⏎⏎
- *}⏎⏎
- --⏎⏎
- …”⏎⏎
- cual
- .";⏎⏎
Suppresses
- D
- D
- O
- l
- d
- atory
- L
- N
- ,