end-of-document boundary tokens
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the hidden marker that signals the end of one web page and the start of another. It is most active on the last word just before that break. Turning it up made the writing wander and repeat, with no clear topic.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
body structure while another one is about body function. But if you want to study them briefly and combine then you can download human anatomy and physiology at the end.<|endoftext|>Increasing the impact of research via wider dissemination of the findings is a well-known strategy
-
Exposure Attention Interpretation Exposure Exposure highlights the stimulus to which a consumer is exposed to. Exposure can be either deliberate or random. ...⏎Not exactly what you need?<|endoftext|>Allegany County’s
-
of the stock has dropped due to poor fundamentals. There are a few ways to check if a dividend is safe, and this post will teach you just that.<|endoftext|>3 September 2016⏎Layer by layer, building with eroision
-
utf8mb4) bytes per character can be used. So if one specifies VARCHAR(50) CHARSET utf8mb4, …[Read more]<|endoftext|>To actually reduce pounds in a healthier manner, it is perfect to burn fat gradually
-
Environmental management Observe/Discuss:⏎- Environmental management Let’s Discuss:⏎- Environmental management Observe:⏎- Environmental management Let’s think:⏎- Environmental management Paragraph<|endoftext|>Organic More
-
where certain mail servers is given as authorized mail server for your domain. The recipient after receiving the mail from your domain, can verify with your domain SPF record to<|endoftext|>Researchers from the Sloan Digital Sky Survey (SDSS-II) announced the discovery of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I will not be able to stop myself from being... I have been thinking about it... and I will not be able to stop myself from... I will be the same. Okay, that's all. I have been thinking about it...
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
21, 1 PM⏎World StampsNov 22, 2021, 7 PM<|endoftext|>At SACRE, the Fluent CFD code has been used in the past 15 years for research as well as
-
able to develop more focused methods to control hESC differentiation and move closer to clinical therapies. (ANI)<|endoftext|>Blaeu, Joan (1596-1673)⏎[Original engraving and etching cartography/
-
the 1890s the Night Riders had done their part, Jim Crow laws were firmly in place and the Confederate Party had a strong power base in the
-
between the voltage and current, it is known as the active power. The second term is time-varying, it depends<|endoftext|>The Difference Between LDL and HDL Cholesterol: Blood cholesterol is an important indicator of cardiovascular health. Maintaining optimal
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:108 suppresses
- L9:1399 excites
- L8:790 excites
- L8:436 suppresses
- L8:163 suppresses
- L9:1148 suppresses
- L11:634 suppresses
- L5:76 suppresses
- L8:528 excites
- L11:1150 excites
- L6:123 suppresses
- L8:1119 weakly suppresses
- L11:835 weakly suppresses
- L9:2258 weakly suppresses
- L11:1263 weakly suppresses
- L9:1131 weakly suppresses
- L10:530 weakly suppresses
- L8:824 weakly suppresses
- L11:1379 weakly excites
- L5:159 weakly suppresses
- L11:452 weakly suppresses
- L2:566 weakly suppresses
- L8:80 weakly suppresses
- L2:637 weakly suppresses
Feeds later layers
- L14:2682 suppresses
- L16:787 suppresses
- L13:1471 excites
- L14:2600 excites
- L18:1288 suppresses
- L14:2198 excites
- L13:853 excites
- L13:397 suppresses
- L17:574 suppresses
- L13:2371 suppresses
- L13:2774 excites
- L14:2525 suppresses
- L14:2032 suppresses
- L13:1612 weakly suppresses
- L13:1236 weakly suppresses
- L14:1023 weakly suppresses
- L13:2037 weakly suppresses
- L13:201 weakly suppresses
- L15:1346 weakly excites
- L14:2574 weakly suppresses
- L13:2336 weakly suppresses
- L15:1121 weakly suppresses
- L13:1119 weakly suppresses
- L19:1193 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Ping
- EAR
- lyn
- awan
- ude
- ihat
- ilon
- úb
- Faces
- ($__
Suppresses
- ptoms
- Автор
- rosso
- 有效性
- 整车
- ��
- ERCHANT
- мом
- QUIRED
- ОР