first pieces of split words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the first chunk of a word that has been split into pieces, such as 'po' in poops, 'comp' in compendium or 'accom' in accompaniments. Turning it up made the text repeat the word 'Chapter', which does not clearly relate to these examples.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
othyroid or anemia. Weak digestion leads to gas and bloating and often times your poop will become stinky. If you frequently have gas and stinky poops it means that your digestion and metabolism may be weak.⏎Looking at your poop
-
Milton- Ulladulla region⏎Produced in consultation with the Kupa Piti Kungka Tjuta, the Senior Aboriginal⏎Women from Coober Pedy, South Australia. Documents their knowledge of atomic⏎tests in the
-
half, and half again, to⏎make four smaller rectangles. How many different ways can you fold⏎This problem focuses on Dienes' Logiblocs. What is the same and⏎what is different about these pairs of
-
on their walk – perhaps they can guess what order they will spot them in!⏎✍Make up the checklist together – we’ve used stickers from our Out and About sticker pack but you can just as easily draw or write on some blank stickers.⏎👀
-
structures. This Handbook explores the basic international human rights principles relating to free and fair elections and the right to take part in government. Although it is not an exhaustive compendium of electoral issues, it does provide some notion
-
Indian plum), marula, vangueria, tamarind, vitex and ‘jujube’ are picked in the wild.⏎They are used as accompaniments for starchy
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: hard trade tradeistrous trade tradeistrous trade tradeistrous trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade trade
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Fiction and Children's Lit⏎As kids transition to reading chapter books, it can be difficult to find them good literature crafted by master storytellers. I've found that authors who write
-
Megan Smith0⏎A Hummingbird’s Amazing Journey⏎by Robert Burleigh⏎- Language: english⏎- Format: hardcover, 40 pages⏎- Publisher: Holt Books for Young Readers (Henry Holt
-
reader not only an understanding of the principles of proper biblical interpretation but also the ability to apply those principles in sermon preparation, personal Bible study, or writing. This popular book outlines a five-step hermeneutical procedure that includes: (1
-
format with a step-by-step approach to the calculation and administration of drug dosages. It covers the ratio and proportion, formula, and dimensional analysis methods. This popular text focuses on enhancing the learning experience of students at all curricular levels by making
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:2877 suppresses
- L18:1745 suppresses
- L24:575 suppresses
- L23:2352 suppresses
- L22:1468 suppresses
- L11:2930 suppresses
- L20:2809 weakly suppresses
- L19:197 weakly excites
- L6:2570 weakly suppresses
- L24:1657 weakly excites
- L19:1519 weakly suppresses
- L19:1896 weakly excites
- L9:824 weakly excites
- L20:648 weakly suppresses
- L3:746 weakly suppresses
- L19:322 weakly suppresses
- L25:528 weakly suppresses
- L22:330 weakly suppresses
- L16:2824 weakly excites 'in' after 'published' or 'appears'
- L8:14 weakly excites
- L3:904 weakly excites
- L5:1502 weakly excites Bible and book words
- L13:2227 weakly excites
- L21:1050 weakly suppresses
Feeds later layers
- L27:1721 strongly excites
- L27:2138 weakly excites
- L27:2783 weakly suppresses
- L27:2953 weakly excites
- L27:2759 weakly suppresses
- L27:984 weakly suppresses
- L27:559 weakly excites
- L27:2698 weakly excites
- L27:2411 weakly suppresses
- L27:2091 weakly excites
- L27:2445 weakly excites capital B starting a name or citation
- L27:746 weakly suppresses
- L27:1788 weakly excites
- L27:2679 weakly suppresses
- L27:1650 weakly suppresses
- L27:2707 weakly excites
- L27:2639 weakly suppresses
- L27:2740 weakly suppresses
- L27:1201 weakly suppresses
- L27:80 weakly suppresses
- L27:2213 weakly suppresses
- L27:2060 weakly excites
- L27:2132 weakly suppresses
- L27:2741 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- book
- book
- books
- Book
- 书中
- 书
- books
- _book
- Book
- 这本书
Suppresses
- служ
- 役
- rous
- жен
- 있게
- toa
- asl
- ляет
- DN
- antor