unclear: text just before document breaks
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is weak and scattered. Its highest readings come at the points where one web page ends and the next begins, but the pattern is loose and the steering output shows no clear effect.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
]⏎[ back to Sever Tipei's home page | Computer Music Project | Music Composition and Scientific Sonification Project ]<|endoftext|>We all face grief in life and each individual handles grief differently. Grief has
-
the behavior of websites, computer programs, various online applications, etc. Namely the execution of commands within program files makes the web as dynamic and flexible as we know it today. Files are also used for data processing purposes. Data files store data
-
, then The Gratitude Project is the book for you.⏎Reviewed by Lucy Boomer, People & Organisational Development Manager<|endoftext|>Priests and People (UK). 6 pp.⏎IT IS A FEW
-
is much cooler than explaining it.⏎Thanks for Subscribing!⏎You'll need to confirm your email, so please check your inbox.⏎(click anywhere to close)<|endoftext|>According to findings of a major HIV prevention trial presented Monday, March 4,
-
the center.⏎By blowing the air between the books, you have an increase in velocity and a decrease in pressure, thus a net downward force on the paper.<|endoftext|>On May 28, 1828, began the official life
-
applications include improved communications technology, television displays and night-vision devices.⏎Tags: Lene Vestergaard Hau, physicist, spped of light.<|endoftext|>The Real
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I was told, "I was told, "I was told, "I was told, "I was told, "I was told, "I was told, "I was told, "I was told, "I was told
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ricular ejection fraction falls, the risk of SCD increases regardless of the underlying cause of the heart disease. Ironically, CHF patients who receive certain types of antiarrhythmic drugs are particularly
-
list of goals and check them off as you complete them. This could help you be more responsible in school.⏎- Another use of cell phones – Isn't it amazing how many features there are on a cell phone? Not just for staying in touch
-
source code for the Diebold TS and TSx voting machines. She recovered the code from the Diebold website. 1 What unfolded was a fascinating chronicle of corporate irresponsibility
-
ilisa's fourth birthday I started to analyse one particular class of Lunda-designs. As these designs turned out to have some interesting properties I gave them the name of Liki-designs. To the left are two examples.⏎How may we
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:284 suppresses
- L11:346 excites
- L9:720 excites
- L12:2210 excites
- L9:255 excites
- L11:2097 excites
- L11:236 excites
- L12:360 suppresses
- L8:220 excites
- L10:2194 excites
- L9:507 excites
- L11:2337 excites
- L7:2153 excites
- L11:1985 weakly suppresses
- L8:1723 weakly suppresses
- L8:406 weakly excites word after a question starter
- L12:320 weakly suppresses
- L3:435 weakly suppresses
- L7:1183 weakly suppresses
- L12:1720 weakly suppresses
- L10:408 weakly suppresses
- L10:867 weakly excites
- L12:220 weakly excites
- L8:1279 weakly suppresses
Feeds later layers
- L15:919 excites
- L14:2409 excites
- L18:1932 excites
- L14:2753 suppresses
- L14:1933 excites
- L20:1396 suppresses
- L14:1448 weakly suppresses
- L16:504 weakly excites
- L14:1300 weakly excites
- L16:1308 weakly suppresses
- L21:1531 weakly suppresses
- L14:2029 weakly excites
- L27:1123 weakly excites
- L17:2818 weakly suppresses
- L14:2429 weakly suppresses
- L14:2077 weakly excites
- L14:3031 weakly excites
- L15:2037 weakly excites
- L14:1866 weakly excites
- L15:893 weakly excites
- L20:1967 weakly excites
- L15:639 weakly suppresses
- L18:2719 weakly suppresses
- L19:2604 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- imb
- stk
- 垧
- ướ
- 上下
- üt
- pickups
- }*/⏎
- 贸
- ipeg
Suppresses
- realised
- ENDOR
- 见证
- ocabulary
- GroupName
- fate
- 很久
- existence
- ardo
- doctype