colon in a title and subtitle
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the colon that separates a book, article or report title from its subtitle, such as "The Value of Everything: Making and Taking...". Turning it up did not produce a clearly related change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
life. But what’s being left out?⏎During one conversation at Food Secure Canada 8th National Assembly in Halifax, which was titled “Waves of Change: Sustainable Food for All,” community developers and food justice advocates, Aja Peterson and
-
magazine's "Lay of the Land."⏎And for background on the coal industry that's pushing this bad idea, download our report "The Dirty Truth About Coal: Why Yesterday's Technology Should Not Be Part of Tomorrow's Energy Future."⏎Make Mine
-
.S. soldiers.⏎Text adapted from “The Fight for Equal Rights: A Recruiting Poster for Black Soldiers in the Civil War” in the February
-
Revolution on Local Governments⏎- The Shale Revolution and Water Quality⏎Common Resources — Feb 7, 2018⏎The Facts on Fracking: A Podcast with Daniel Raimi⏎In this podcast, RFF’s Daniel
-
… May 04, 2010 · LEDC flooding case study Bangladesh 1998 1. LEDC Flooding Case Study: Bangladesh 1998 2. Between July-September 1
-
The Value of Everything: Making and Taking in the Global Economy by Mariana Mazzucato. Copyright
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to be careful with my own ideas, and I need to be careful with my own thoughts, and I need to be careful with my own thoughts, and I need to be careful with my own thoughts, and I need to be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Kids Listen Activity Podcast, Episode 9: Aaron's World Presents Origin of Dinosaurs⏎Aaron’s World is a fun and imaginative science-themed audio
-
11.1 Information Library|⏎- load exponent of a floating point number⏎c99 [ flag... ] file... -lm [ library... ] #include <math.h> double ldexp(double x, int exp);⏎float ldexp
-
bursts of colour as the different wild flowers start appearing with the summer rains. I recently saw a beautiful red coloured flower up on the high grasslands, Tritoniopsis caffra. Which has sword like leaves and vibrant red asymmetrical flowers that
-
shod feet touch the ground are apt to come home with painful stings inflicted by a tiny insect with a long name: Solenopsis invicta Buren.⏎Nicknamed RIFA, for red imported fire ant
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:183 weakly suppresses
- L0:300 weakly excites
- L0:902 weakly suppresses
- L0:965 weakly excites
- L0:170 weakly excites
- L0:1530 weakly suppresses
- L0:2926 weakly excites
- L0:3026 weakly suppresses
- L0:1301 weakly suppresses
- L0:905 weakly suppresses
- L0:1748 weakly excites
- L0:120 weakly excites
- L0:849 weakly excites
- L0:2069 weakly excites
- L0:1963 weakly excites
- L0:989 weakly excites
- L0:1224 weakly suppresses
- L0:2113 weakly suppresses
- L0:2065 weakly suppresses
- L0:907 weakly suppresses
- L0:100 weakly excites first digit '1' of a year
- L0:1 weakly suppresses
- L0:866 weakly suppresses
- L0:1898 weakly excites
Feeds later layers
- L2:650 weakly suppresses
- L16:1518 weakly suppresses
- L25:1020 weakly excites
- L19:1557 weakly suppresses
- L18:2331 weakly suppresses
- L7:599 weakly suppresses
- L3:641 weakly excites
- L7:301 weakly excites
- L5:2292 weakly suppresses
- L24:1611 weakly suppresses
- L14:1786 weakly excites
- L23:2416 weakly suppresses
- L6:72 weakly suppresses
- L11:2606 weakly suppresses
- L11:2450 weakly suppresses
- L24:1481 weakly excites
- L23:2308 weakly excites
- L26:1991 weakly excites
- L23:1453 weakly suppresses
- L19:1212 weakly suppresses
- L8:1720 weakly excites
- L18:2121 weakly suppresses
- L22:605 weakly suppresses
- L25:1465 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- EDIUM
- 家企业
- gie
- structions
- erview
- gies
- Husband
- <Entry
- hubby
- utations
Suppresses
- ing
- imir
- ibr
- as
- nodeName
- bald
- Notícias
- .getNode
- nodeName
- node