split names and comparative stems
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The strongest pulls come from two sides. The positive side fires on the first piece of a split place or drug name, like 'Var' in Varanasi. The negative side fires on word stems right before a comparison ending, like 'lik' in likelier or 'swe' in sweeter. When pushed up, the model wrote 'larger' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Ganges river below:⏎Step 1 Uttarakhand (state + Start)⏎Step 2 Kanpur, Soron, Kannauj, Allahabad, Varanasi, Patna, Ghazipur,Bhagalpur (towns
-
centres.⏎Hundreds of bumboats ferrying goods from warehouses along the river to cargo ships out at sea were moved to a new lighter anchorage at Pasir Panjang by the Port of Singapore Authority.⏎Foul-smelling mud also had to
-
treated father. Male mice in the study were exposed to one of three common anticancer drugs—cyclophosphamide, mitomycin C, or procarbazine—and then allowed to mate with untreated females. After sequencing a small
-
Madison McDermott⏎The Green New Deal Federal Resolution was introduced in 2019 by Rep. Ocasio-Cortez and Sen. Ed Markey as a plan to tackle a trifecta of crises: the climate crisis
-
HG (examples: promethazine or prochlorperazine). However, doctors often recommend that women with HG take certain anti
-
printed copy of this publication.⏎- Our on-line publications are scanned and captured using Adobe Acrobat. During the capture process some typographical errors may occur. Please contact Sharon Hobrla, email@example.com if you notice any errors which make this publication
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: life has come in stages thanks to life itself, thanks to life beings having come forth thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks thanks
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Stress is an underlying factor in illness as it reduces your immune system’s ability to fight off antigens. This means that the more stressed you are, the likelier you are to pick up infections and fight illness.⏎Therefore, a regular workout
-
, and can lead to hospitalization, kidney failure, and even death.⏎Why do people drink raw milk?⏎Some people believe that raw milk tastes sweeter and fresher, and that it’s nutritional properties can help various health conditions. Farmers who
-
usually start ripening in February. The best method to determine if the fruit is sweet is your own taste-test. The longer fruit stays on the tree, the sweeter it becomes. It will not sweeten after being picked. If you can
-
worse and we know this will impact our nature, wildlife, people and food supplies. We urgently need ambitious action to cut our emissions and to build a cleaner, greener economy to tackle climate change before we pass the point of no return that we
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:944 strongly excites
- L26:551 strongly excites
- L19:2597 strongly excites
- L19:2024 strongly excites
- L21:2949 strongly suppresses comma closing 'the more X, the more Y' clauses
- L20:2321 strongly excites
- L22:1988 strongly suppresses "the" in "the more..., the more" phrases
- L20:2491 strongly suppresses
- L24:2340 strongly excites
- L20:2323 strongly excites
- L23:456 strongly suppresses
- L24:847 strongly excites
- L20:2852 excites
- L23:751 excites
- L25:3025 excites
- L25:657 suppresses
- L26:124 excites
- L18:2761 excites
- L21:2031 excites
- L18:2316 excites
- L15:1060 suppresses
- L19:739 excites
- L23:2817 excites the word "no" in "no longer"
- L17:2278 excites
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- larger
- 更大
- 更大的
- longer
- 更
- wider
- bigger
- 更高的
- 更高
- broader
Suppresses
- orphism
- ibur
- ‾
- icious
- яет
- thanks
- lobe
- CHASE
- دة
- renched