'the' after math verbs like multiply
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'the' when it follows a math action such as 'multiply the' or 'divide the', as in instructions for finding a percentage. Turning it up gave text that was not about maths, so the link is mainly visible in the examples.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the percentage of a number.⏎Another way to calculate the percentage of a number is to divide the number by its maximum possible value. You can do this by multiplying the sum of the numbers and the mark by their total. Once you have this figure
-
number, try a calculator.⏎To find the percentage of a number, you should first know how many decimal places it falls under. You can do this by multiplying the number by the maximum possible mark. Once you’ve determined the maximum, you can
-
you the result instantly and accurately, and is an excellent way to check the accuracy of your calculations.⏎To convert a decimal number to a percentage, you simply divide the decimal by the maximum possible mark. In the case of a number, you can
-
a percentage.⏎To find the percentage value of a mark, you’ll need to know its total mark. In order to find this, use basic arithmetic. Divide the mark by the highest possible mark and multiply the answer by 100 to
-
across the press slide becomes difficult.⏎The strip layout in the accompanying illustration represents a process for an eight-station progressive die. To calculate the tipping moments, multiply the cutting and forming forces
-
AC generator, the output frequency of said AC generator being proportional to the speed of said shaft plus the frequency of said frequency converter, which comprises:⏎means connected to said AC mains lines and to said output lines for generating a first control signal (e
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Can a company, or should it, have a policy of not allowing for certain categories of work? I'm not sure how or if. The question is, if, and whether, and it's not possible, even if some are.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
poles and shout. Never run or bend down as this will make you look like prey. Call children to come next to you.⏎These
-
problem escalates during summers, when people beat the heat with chilled drinks.⏎AdvertisementFurther sinusitis is always on the rise due to
-
solar system. The Earth is a planet. I'm sure you knew that... There are in fact 9 major planets around the sun: Mercury, Venus, the Earth, Mars, Jupiter, Saturn, Uranus, Neptune and Pluto. Only
-
, portions of the vessel (of no commercial value) began to disappear between our visits. Often, when armchair interest escalates to spade wielding (or the use of other exploratory devices) archaeologists and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:52 excites
- L6:1218 weakly suppresses
- L3:1934 weakly excites
- L4:2284 weakly excites
- L4:2626 weakly excites
- L2:1253 weakly suppresses
- L7:1949 weakly excites
- L3:2398 weakly suppresses
- L0:1795 weakly suppresses
- L5:2921 weakly excites
- L4:332 weakly excites
- L5:34 weakly excites
- L6:61 weakly suppresses
- L6:2524 weakly suppresses
- L4:1517 weakly suppresses
- L3:2858 weakly excites
- L3:504 weakly excites
- L6:2354 weakly excites
- L5:1267 weakly excites
- L2:2025 weakly excites
- L8:563 weakly excites
- L3:1427 weakly excites
- L8:271 weakly suppresses
- L2:2965 weakly suppresses
Feeds later layers
- L24:2926 weakly excites
- L12:2875 weakly excites
- L18:2375 weakly suppresses
- L18:1193 weakly suppresses
- L18:410 weakly suppresses
- L15:1131 weakly excites
- L25:2637 weakly excites
- L16:1776 weakly suppresses 'the' after a verb or preposition
- L11:1476 weakly suppresses
- L27:1877 weakly suppresses
- L23:2533 weakly excites
- L21:2602 weakly excites
- L10:362 weakly excites
- L20:1810 weakly suppresses
- L21:1857 weakly excites
- L10:796 weakly excites
- L19:476 weakly excites
- L22:319 weakly excites
- L18:315 weakly suppresses
- L20:331 weakly suppresses
- L15:344 weakly suppresses
- L14:1895 weakly excites
- L15:1103 weakly excites
- L14:2966 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- asting
- asted
- astic
- gments
- asiswa
- unto
- ण
- zeitig
- :title
- asts
Suppresses
- kre
- kop
- aket
- (ft
- tet
- Ệ
- ético
- erty
- indefinitely
- 德州