weighing, counting and measuring
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on words about measuring things: weighing gold, counting stars or steps, using a balance, measuring something. When turned up, the model's text drifted toward temperatures and thermometer readings, a loose match to the same theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, go to the place marked out by the Lord your God for himself;⏎Gold cannot be exchanged for it,and silver cannot be weighed out for its price.⏎Gold and glass do not compare with it,and articles of
-
“Look now toward heaven, and count the stars if you are able to number them…. So shall your descendants be” (
-
stration: This could be a useful introduction to the idea of density of a liquid.⏎Demonstration: This method uses an equal-arm balance rather than a domestic spring balance.⏎Class practical: A simple method for comparing the density of liquids.⏎There is
-
people have resumed their morning and evening walks in the neighbourhood parks/areas. It’s the same walk with the same shoes with cushioned soles.⏎You count your steps on the app in
-
20th century. Some historians consider the memory of the Shoah to be a new civil religion of the western world, a negative yardstick by which to measure the legitimacy of our democratic institutions.⏎Everyone agrees that the Shoah is a major
-
standard filmmakers today still are struggling to measure up to,” he said.⏎Kaufman said the Disney film is based,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: a little problem, a question. I need to find a way to represent this in a better format. Let me think it up, but I can't get the image to show up. Let me think it's better. Let me think
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
quality of the composting process. It is recommended to always add carbon materials in shredded form and food scrapes in small pieces. Small particle size increases the surface area and helps the microorganisms to decompose organic waste quickly.⏎The two main stages
-
02 and 2003. Sediment delivery during each pulse was highly variable (11,300-43,800 metric tons), and was greatest during rising limbs of Mississippi River flood events. Overland
-
medium under controlled environmental conditions.⏎This propagation method produces plants of uniform genetic makeup, increases the rate of plant production and has been used for the elimination of diseases in certain plants.⏎T
-
surface friction and wear between interacting surfaces, to dissipate heat, prevent corrosion and transfer of power. In general, a good lubricant should have a high viscosity index, high flash and fire points (higher than the operating temperature of the machine),
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:2935 excites
- L4:1939 suppresses
- L4:2662 excites
- L3:2405 excites
- L3:2615 excites
- L0:249 weakly excites ordinal suffix "nd" after numbers
- L4:3005 weakly excites
- L3:2872 weakly excites
- L3:1973 weakly suppresses
- L4:1024 weakly suppresses
- L4:1862 weakly suppresses
- L3:2282 weakly excites
- L2:2143 weakly excites
- L3:1708 weakly suppresses
- L4:2251 weakly excites
- L4:3053 weakly suppresses
- L3:1456 weakly excites
- L0:1851 weakly suppresses
- L2:1148 weakly excites
- L4:1399 weakly excites
- L4:25 weakly excites
- L3:2634 weakly suppresses
- L2:2989 weakly excites
- L4:926 weakly excites
Feeds later layers
- L10:127 excites
- L10:1538 excites
- L9:712 excites
- L8:1589 excites
- L10:294 excites
- L6:175 suppresses
- L7:91 suppresses
- L17:1735 excites
- L23:549 excites
- L9:660 excites
- L19:1603 excites
- L8:1466 excites
- L11:95 suppresses
- L11:2223 excites
- L21:1450 weakly excites
- L10:2214 weakly excites
- L20:2792 weakly excites
- L7:2042 weakly excites
- L11:781 weakly excites
- L10:229 weakly excites
- L25:1250 weakly excites
- L9:806 weakly excites
- L10:1967 weakly excites
- L9:391 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 尺
- second
- peso
- everything
- tres
- scale
- 测
- то
- measurement
- second
Suppresses
- .']
- ображен
- 一角
- ellant
- ogenesis
- ==='
- istique
- formation
- 阙
- unpl