'about' or 'approximately' before a number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the words 'about' and 'approximately' when they come right before a number or amount, like 'about 27%' or 'about 3,000'. Turning it down made the model repeat 'about' and 'approximately' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
drop off from 7 million jobs in 2006 to 4.5 million in 2009.⏎Part of the decline is that about 27% fewer businesses with employees are being started, the study says.⏎
-
that in 2015 the number of mobile phone subscribers in North Korea reached 3.24 million, (about 13%) and that about 60 percent of the population in Pyongyang, the capital, between 2
-
unit of GDP should go down by 40% - 45% from the 2005 level, non-fossil energy should make up about 15% of primary energy consumption, and forest coverage should increase by
-
for U.S. teens, accounting for more than one in three deaths, according to the Centers for Disease Control and Prevention. In 2009, about 3,000 15–to-19-year-olds
-
is a leading cause of poor quality of life and annually there’s an estimated 9M people falling ill with and 1.5M dying of it. About 4000 people die of TB every day in the whole world,
-
2015. The opioid crisis is largely responsible for the increase—for example, two thirds of overdose deaths are associated with opioid misuse. Surprisingly, about half of all opioid overdose deaths are related to medications from prescriptions (National Academy of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately approximately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
6 trillion degrees Celsius (10.8 trillion °F)! Definitely hotter than the temperature of the centre of the Sun, which comes in at a puny 5 million °C (9 billion °F).⏎This record temperature
-
being used.⏎Here`s a blurb about their current design process :⏎Primary concept and development work takes place at the Billund⏎headquarters, where the company employs approximately 120 designers.⏎The company also has smaller design offices in the
-
these melanomas occur in preexisting moles.⏎How quickly can a mole turn cancerous?⏎Melanoma can grow very quickly. It can become life-threatening in as little as 6 weeks and, if untreated, it can spread to other
-
astronomy . Accreted matter is usually hydrogen rich. It forms the outer envelope of a neutron star, which contains a hydrogen burning shell, with an energy release of about 5 MeV/nucleon in a stable burning. Helium ashes
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:780 strongly excites 'of' before a measured value
- L23:1514 strongly suppresses
- L18:291 strongly suppresses
- L23:947 strongly excites
- L19:1921 strongly excites
- L23:2791 strongly suppresses
- L20:2316 strongly suppresses
- L22:481 strongly excites
- L19:1222 strongly suppresses
- L23:1723 strongly suppresses
- L21:175 strongly suppresses
- L22:2408 strongly excites
- L21:326 suppresses
- L23:1919 suppresses
- L10:868 suppresses
- L20:1001 suppresses
- L19:1211 excites
- L16:1919 suppresses
- L20:1998 suppresses
- L19:2151 excites
- L21:1284 excites
- L13:2125 suppresses
- L15:2797 suppresses
- L22:685 suppresses
Feeds later layers
- L27:1058 strongly suppresses
- L27:1705 strongly suppresses
- L25:857 suppresses
- L25:1212 suppresses
- L25:2963 suppresses
- L25:2908 suppresses
- L25:1264 suppresses
- L25:734 suppresses
- L25:1136 suppresses
- L25:2543 suppresses
- L26:2770 suppresses
- L25:1369 suppresses
- L25:2902 suppresses
- L25:1381 suppresses
- L26:2537 suppresses
- L25:992 weakly suppresses
- L25:921 weakly suppresses
- L25:1020 weakly suppresses
- L25:2035 weakly suppresses
- L25:329 weakly suppresses
- L27:1595 weakly suppresses
- L27:628 weakly suppresses
- L26:474 weakly suppresses
- L26:1848 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 态
- onomous
- pez
- ingham
- ndl
- isms
- 责任制
- Single
- uite
- ismo
Suppresses
- 约
- 約
- approximately
- 约为
- about
- 大约
- approximately
- about
- around
- About