middle digits of numbers
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a digit inside a number, most often a zero in a temperature, distance or speed such as 5800 or 280 nm. It is not a clear theme in the steered text, which drifted into questions and technical topics.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
than any of the planets or moons. The Sun's spectrum shows that it has a temperature of 5800 Celsius. The high temperature on the Sun's surface causes it to emit a great
-
Mars in several slingshot maneuvers to accelerate and help hurdle the spacecraft toward its destination. The comet is traveling toward the sun at 34,175 mph. After a high-speed chase across nearly 4 billion miles (6.
-
adopting the 20-20-20 rule: Take a 20-second break to look at something 20 feet away every 20 minutes.⏎This will help rest your eyes. Also, blink frequently to help keep
-
breweries, bottled water plants and pharmaceutical facilities.⏎UV-C light, often referred to as Germicidal UV, exists between 200 and 280nm and is therefore invisible to the naked eye. Naturally occurring UV-C rays from
-
at the asteroid 2005 YU55 a few days ago, when it passed the Earth at the relatively close distance of about 320,000 km. One of those eyes was actually in space as well
-
dawn and spring on Earth.⏎English is Germanic and therefore based on Proto-Indo-European (PIE) language. PIE was spoken around 3500 B.C.E. by a group of nomads called the Aryans living
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if I have a group of 10000 - 5000 - 5000 - 5000 - 5000 - 5000 - 500
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
against the disease,” says UCSD’s Kim Barrett.⏎The team grew cancer cells in the laboratory and found that leptin could stimulate their growth. In two out of three cell lines, leptin also blocked normal programmed cell death, apoptosis, which
-
ypti. This 4-millimeter-long insect is responsible not only for the Zika outbreak but also for transmitting yellow fever and two other excruciating diseases, dengue and chikungunya, that
-
ven tongues like as of fire’. So, once again fire possess ambiguous symbolism: the element is both associated with both the Devil and hell, and God and the Holy<|endoftext|>Previous: [SVG]
-
keep working on several issues aimed at improving relations.⏎Trump and Kim held another face-to-face meeting last month in Vietnam. That meeting produced no major agreements. At both meetings, the leaders reportedly considered a proposal to open a liaison office in North Korea
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2008 excites
- L13:2099 suppresses
- L11:233 suppresses
- L14:826 suppresses
- L14:1601 suppresses
- L6:284 excites
- L13:1575 excites
- L10:167 suppresses
- L8:298 excites
- L14:2057 excites
- L13:330 suppresses
- L14:2291 suppresses
- L12:1065 excites
- L13:2887 suppresses
- L14:990 suppresses
- L11:1320 suppresses
- L14:2916 excites
- L13:1370 excites
- L13:2180 suppresses
- L13:1800 suppresses
- L13:1729 excites
- L13:2727 suppresses
- L13:2715 suppresses
- L14:2651 excites
Feeds later layers
- L16:2662 suppresses
- L16:199 excites
- L17:390 suppresses
- L16:474 suppresses
- L16:1327 suppresses
- L19:2647 weakly suppresses
- L16:297 weakly excites
- L16:1350 weakly suppresses
- L19:713 weakly excites
- L17:2057 weakly excites
- L16:1761 weakly suppresses
- L16:229 weakly excites
- L16:1633 weakly excites
- L19:2453 weakly suppresses
- L19:862 weakly excites
- L19:1496 weakly suppresses
- L19:249 weakly suppresses
- L19:2587 weakly suppresses
- L18:732 weakly excites
- L16:500 weakly excites
- L18:19 weakly excites
- L18:1143 weakly suppresses
- L17:565 weakly suppresses
- L16:1344 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ably
- rylic
- izable
- ized
- izing
- zed
- 谚
- Rule
- 他又
- aving
Suppresses
- başına
- ниц
- .getColumn
- antics
- /categories
- .getInfo
- ilians
- া�
- GetString
- -dem