colon after a said or explains verb
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the colon that comes right after a speaker phrase, like "Professor Bill Davies said:" just before a quote. Turning it up made the model produce strings of asterisks and blanks, which have nothing to do with quotes.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
device, and warn them when they are at risk of a seizure and how they can modify their behaviour or change their situation to prevent this.”⏎Professor Schelter added: “We live in a world where there is a massive amount of data, and
-
unique partnership between the BBC, the British Museum and 350 museums and institutions across the country.⏎Director of The Manchester Museum, Dr Nick Merriman said: "It's
-
how brain circuits are arranged.⏎Andrew Leuchter, director of the Semel Institute’s TMS clinical and research centre (University of California, LA) explains: "By pulsing it with energy repeatedly, we’re changing the way that area
-
to a global market.⏎One of the problems of existing vaccines against foot and mouth disease is identifying which animals have been vaccinated and which haven't.⏎Dr Charleston says: 'The complete absence of some viral proteins from this new vaccine will also allow companion
-
used to help reduce the engine's fuel consumption.⏎Commenting on the projects, Project lead and Lecturer in the Department of Mechanical Engineering, Dr Copeland said: "These two research projects are at the cutting edge of research in turbomachinery
-
Professor Bill Davies has been exploring the challenges likely to be posed by global population growth for the UK’s first free online course in food security.⏎Professor Bill Davies said: “Food security is one of the grand challenges facing the world, there is going
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if we are in a situation where we are in the first time we are in the situation we are in the first time we are in the situation, we are in a situation we are in the situation we are in the situation we are in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
by Sam.⏎Example of Present Perfect: Active: Many tourists have visited that castle. Passive: That castle has been visited by many tourists.⏎Example of Future (Will): Active: Tonight, John will wash the dishes. Passive: Tonight, the
-
Related research" (further below) or search for a different version of it.⏎Volume (Year): 42 (2011)⏎Issue (Month): 2 (June)⏎|Contact details of provider:|| Web page:
-
. I'll see her tomorrow.⏎In #1 "going to" implies a previous arrangement or understanding.⏎In #2 "will" does not carry the implication of an arrangement, and can be a spontaneous decision
-
his father not died? (9) They had returned the home? (10)You had finished this book?⏎Past Perfect Tense Negative⏎Subject + had not + verb 3rd from + object.⏎Past Perfect Interrogative Negative
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:2793 excites
- L20:1772 excites
- L19:1817 suppresses
- L20:2552 excites
- L19:1160 suppresses
- L14:177 suppresses
- L19:991 suppresses
- L18:2015 excites
- L20:79 excites
- L19:223 excites
- L19:836 excites
- L13:1550 suppresses
- L19:1326 excites
- L18:228 suppresses
- L19:2075 excites
- L19:1153 excites
- L15:1601 suppresses
- L14:2651 suppresses
- L19:2226 excites
- L19:1156 excites
- L18:652 suppresses
- L20:353 excites
- L18:725 suppresses
- L6:850 excites
Feeds later layers
- L22:161 excites
- L25:135 suppresses
- L27:193 weakly suppresses
- L23:43 weakly excites
- L23:444 weakly suppresses
- L22:165 weakly suppresses
- L24:121 weakly excites
- L25:420 weakly suppresses
- L24:132 weakly excites
- L23:122 weakly suppresses
- L23:420 weakly suppresses
- L27:338 weakly suppresses
- L25:16 weakly excites
- L25:334 weakly suppresses
- L26:554 weakly suppresses
- L27:1698 weakly suppresses
- L24:20 weakly excites
- L27:498 weakly suppresses
- L24:331 weakly suppresses
- L24:125 weakly suppresses
- L26:356 weakly excites
- L22:108 weakly excites
- L23:881 weakly suppresses
- L26:757 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- …”⏎⏎
- ”).
- …”
- uces
- ").⏎⏎
- ”.⏎⏎
- ”
- {}).
- "));⏎⏎
- ").
Suppresses
- �权
- >(()
- ([⏎
- ({⏎
- ',{⏎
- :[⏎
- |=⏎
- ("|
- 的城市
- فة