numbers and list openers, mixed
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is loosely tied to numbers: it fires on digits and number tokens in arithmetic, years and totals. It goes quiet or negative on colons that introduce a list. Turning it up or down gave text that did not clearly follow this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
equivalent? Yes, they are.⏎Now we can add the cardinal numbers and the numerators. First the cardinal numbers. That is 2 + 3 = 5. And then the numerators. 1 + 1 = 2
-
in school to increase from 75 to 88 percent. MENA achieved the same increase in 2 decades: from 1990 to 2010.2⏎However, it is important to note that regional
-
3. Pope Paul III, who convoked the Council, oversaw the first eight sessions (1545–47), while the twelfth to sixteenth sessions (1551–52) were overseen by
-
3 constructed in 1938 have been abandoned. They were located in Iverson Park. The present system consists of Wells No. 4 through 10, two elevated storage tanks, one ground level reservoir and a distribution system
-
early 1900s. The construction of the hotel began in 1901 and was completed in just two years, in 1903. The hotel was designed by Harrison Albright, an architect known for his
-
umes, animal manure, compost and crop residues. Organic nutrients are slowly released as materials decompose. Compost and manure provide additional benefits, such as increasing organic matter which contributes to building healthy soil.⏎Why don’t all farmers use nutrients
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first and most commonly used in the ingraph, the most commonly used in the second 2022 research head in the first reheptetand (1) (2) The second head in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to calculate and return the volume of a sphere based on the given radius.⏎- Your second subroutine should be called getVolumeOfCuboid(), take three parameters called width, length and height and apply the relevant formula to calculate and return the volume
-
Vitamin K Deficiency⏎- Food Sources of Vitamin K⏎In the early 20th century, it was believed that humans only required four types of nutrients: proteins, carbohydrates, fats, and minerals. Since then, our understanding of health
-
also packed with vitamins and minerals, fiber and an extensive amount of important phytochemicals.⏎What are carbohydrates?⏎Carbohydrates are molecules consisting of three elements: carbon, hydrogen and oxygen. They fuel the body with the energy it needs for
-
form what we call our solar system. The Earth is a planet. I'm sure you knew that... There are in fact 9 major planets around the sun: Mercury, Venus, the Earth, Mars, Jupiter, Saturn, Uranus,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:2463 suppresses
- L10:2827 weakly suppresses
- L9:1860 weakly excites
- L10:1437 weakly suppresses
- L7:525 weakly suppresses
- L19:2794 weakly excites
- L14:1311 weakly suppresses
- L8:496 weakly suppresses
- L16:804 weakly suppresses
- L4:2871 weakly excites
- L12:1858 weakly excites
- L18:486 weakly excites
- L18:2892 weakly excites
- L18:874 weakly suppresses
- L7:1065 weakly excites
- L9:1955 weakly excites
- L17:1880 weakly excites
- L2:1942 weakly excites
- L18:2135 weakly excites
- L10:1723 weakly suppresses
- L17:264 weakly suppresses
- L12:674 weakly excites
- L18:1434 weakly suppresses
- L9:1326 weakly excites
Feeds later layers
- L22:1545 weakly suppresses
- L21:2331 weakly suppresses
- L22:685 weakly excites
- L21:634 weakly excites
- L21:2175 weakly excites
- L22:1099 weakly suppresses
- L21:2397 weakly excites
- L25:460 weakly suppresses
- L21:2660 weakly suppresses
- L25:1282 weakly excites
- L25:2785 weakly suppresses
- L22:559 weakly suppresses
- L21:1523 weakly excites
- L21:1485 weakly suppresses
- L22:1826 weakly suppresses
- L24:976 weakly suppresses
- L22:485 weakly excites
- L24:2538 weakly excites
- L23:1457 weakly excites
- L22:9 weakly excites
- L21:1056 weakly suppresses
- L26:1878 weakly suppresses
- L21:84 weakly excites the word 'according'
- L21:915 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- acular
- usty
- irate
- atee
- azzi
- 功劳
- 酱
- @Table
- inal
- 而来
Suppresses
- صف
- ложение
- lists
- pint
- Demand
- спис
- tere
- -response
- .response
- ЛЕ