acronyms and abbreviations in brackets
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the start of a short form or acronym, such as the opening bracket before 'LVTS' or the 'IS' in 'ISLLC'. Turning it up made the model produce strange, repeated text, so the push itself doesn't show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
The National Science Foundation CARE<|endoftext|>Territorial A-ZA | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S |
-
as the National Qualification for Headship (NPQH) in the United Kingdom and the (Interstate School Leaders Licensure Consortium (ISLLC) standards in the United States. Distributed patterns of leadership have developed in
-
the world competition. Therefore, some educational institutions are moving from traditional language teaching that use only the first language as the medium of instruction to content and language learning (Klippel 2003).⏎The climate of globalisation, in
-
of three concepts undergoing preliminary studies for the three-year, €7 million ($9 million) European hypersonic research project, Long Term Advanced Propulsion Concepts and Technologies (LAPCAT).⏎With €4 million from the European Commission and the rest from
-
that extends halfway out to the sun’s orbit. We know more about where the Milky Way’s spiral arms are.”⏎Named GLIMPSE360 (Galactic Legacy Mid-Plane Survey Extraordinaire project), the deep infrared survey captures only
-
clearing system.⏎- Finance Canada — Company, Canada-wide,⏎- Federal department responsible for Canada's economic performance and regulation of financial institutions.⏎- Large Value Transfer System (LVTS) — Acronym,⏎- System being created by the Canadian Payments Association
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the way in which the future is made of "riddle" and "riddle-riddle". This riddle-riddle-...riddle...hinderlly makes a way to create a non-continuous, non-ve
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
particularly influential to the founding of our country was an Englishman named John Locke (1632-1704). Locke was so influential that Thomas Jefferson listed him as one of
-
modified release (brand names include Priadel, Camcolit and Liskonium).⏎- Lithium citrate comes as a liquid and common brands include Priadel and Li-Liquid.⏎3. Who can and cannot take lithium⏎Lithium
-
the responsibility of preventing local supplies from reaching the British Army in Philadelphia.⏎Edwin Lacey was a relative of the Revolutionary War general and the son of Isaac and Ruth (nee Twining). Lacey was a tall, gaunt, red-headed
-
Latvia is de jure continuous with its declaration November 18, 1918.|⏎Latvia is a country in Northern Europe. The capital is Riga. It is one of the Baltic States, together with Estonia in the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:118 strongly suppresses
- L23:2296 suppresses
- L23:674 suppresses
- L21:83 excites
- L23:2677 suppresses
- L23:1363 excites
- L23:2638 suppresses
- L23:2923 excites
- L5:565 suppresses
- L5:2481 weakly suppresses
- L21:1605 weakly suppresses
- L6:789 weakly excites
- L23:3013 weakly excites
- L4:1548 weakly excites
- L22:217 weakly excites
- L21:42 weakly suppresses
- L23:1747 weakly excites
- L17:739 weakly suppresses
- L21:2331 weakly suppresses
- L12:2774 weakly suppresses
- L11:1240 weakly suppresses
- L4:1312 weakly excites
- L12:2082 weakly excites
- L17:102 weakly excites
Feeds later layers
- L26:843 strongly excites
- L27:1221 strongly excites
- L25:763 strongly excites
- L27:330 strongly excites
- L26:882 suppresses
- L25:432 excites
- L26:2865 weakly excites
- L26:415 weakly suppresses
- L26:2355 weakly excites
- L27:383 weakly suppresses
- L27:1033 weakly suppresses
- L27:2025 weakly suppresses
- L26:2085 weakly excites
- L26:1423 weakly suppresses
- L26:1780 weakly excites
- L26:770 weakly excites
- L25:1317 weakly suppresses
- L27:1774 weakly suppresses
- L27:2685 weakly suppresses
- L27:2255 weakly suppresses
- L25:2040 weakly suppresses
- L26:2525 weakly suppresses
- L26:1509 weakly suppresses
- L26:2845 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- L
- L
- _L
- (L
- =L
- ,L
- $L
- *L
- <L
- )L
Suppresses
- iddle
- 过去了
- elize
- Bounty
- 垠
- Bl
- 越し
- 问他
- 岁以下
- 력