the space right before a number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the blank space that comes just before a number, such as the gap before 14 in 'ages of 14 and 16'. Turning it up made the model's output fall into repeated filler words, not number-related text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
-Drawn, WWI Map Is Up for Auction⏎- Thousands Of FBI Documents About Civil Rights Era Destroyed By Flooding⏎- Ancient Egyptian Woman with 70 Hair Extensions Discovered⏎- Europeans drawn from three ancient 'tribes
-
iers and the key to understanding why mass exists. The most recent book on the subject, The God Particle, was a bestseller.⏎Students in your classes between 7 and 16 years of age can<|endoftext|>Harivamsha MahA
-
3/74 that ended the "economic miracle" once and for all. By the time Herbert Grünewald succeeded Kurt Hansen as Management Board Chairman following the 1974 Annual Stockholders' Meeting, the global economy was undergoing a
-
chaos. But there are also peaceful applications<|endoftext|>An estimated 50,000 to 60,000 farmworkers between the ages of 14 and 16 might be affected by proposed changes to child labor laws
-
changes, the Department of Labor estimates that between 50,000 and 60,000 hired farmworkers are between the ages of 14 and 16. The most important of the proposed child labor changes
-
Course Description and Rationale:⏎A 2006 report by the Corporation for National and Community Service found that 3.3 million college students volunteered in 2005. This course recognizes college students as volunteer leaders with the abilities
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The "
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
0s, but if nobody recorded it in publication<|endoftext|>Opportunities and Challenges in High Pressure Processing of Foods⏎By Rastogi, N K; Raghavarao, K S M S; Balasubramaniam, V
-
required for flight, puncturing a lung, and barely missing his heart.⏎"The pellet broke the coracoid bone," noted Cape Wildlife Center veterinarian Dr. Roberto Aguilar. "It is difficult to set a broken shoulder bone because of the challenge
-
2017 WHSmith and its suppliers.⏎WHSmith High Street Limited Greenbridge Road, Swindon, Wiltshire, United Kingdom, SN3 3
-
successful, the operation could also generate millions of dollars to be used to combat the shrinking of the Salton Sea and the<|endoftext|>The Art of Story Writing⏎by Nathaniel C. Fowler⏎Publisher: Sulley and Kleinteich 19
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:581 strongly suppresses blank slot before a number
- L18:106 suppresses
- L21:339 excites spot just before a year
- L22:372 excites empty spot before a number or "3D"
- L22:824 excites blank before an expected number
- L4:53 excites blank slot before a number
- L21:173 excites
- L18:377 excites number right after 'about' or 'less than'
- L14:191 excites blank spot before a run-on number
- L17:285 suppresses
- L20:2446 suppresses
- L20:433 excites
- L19:781 excites
- L16:41 suppresses
- L6:0 excites
- L19:1207 weakly excites
- L9:7 weakly excites
- L8:111 weakly suppresses the space before a year in dates
- L16:208 weakly suppresses
- L5:334 weakly suppresses
- L22:216 weakly excites
- L20:344 weakly excites hyphen inside compound words
- L16:91 weakly excites
- L18:284 weakly suppresses
Feeds later layers
- L27:170 strongly excites unclear: spaces in mixed-language text
- L25:222 strongly suppresses
- L27:71 excites
- L27:237 suppresses
- L26:17 suppresses
- L27:283 excites the spot right before a number
- L25:33 excites spot where a number is due
- L26:396 suppresses
- L26:423 suppresses
- L25:239 suppresses
- L25:161 excites
- L26:542 suppresses
- L25:736 excites
- L26:97 suppresses
- L27:83 suppresses
- L27:63 excites closing parenthesis in data lists
- L27:112 suppresses
- L27:65 suppresses
- L25:311 excites
- L25:112 suppresses
- L27:22 suppresses
- L27:825 excites
- L27:292 excites
- L27:1017 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- }>
- }>⏎
- themselves
- #
- //
- Movement
- )[
- ):⏎
- }(
- isible
Suppresses
- ⏎
- ⏎
- ⏎
- ⏎