'of' after 'temperature' or 'rate'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it comes right after a measure like 'temperature of' or 'rate of'. Turning it up made the writing wander, and turning it down made it repeat words like 'amount' and 'level'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ormal, air-entraining Type IIModerate sulfate resistance Type IIAModerate sulfate resistance, air-entraining Type II (MH) Moderate heat of hydration and moderate sulfate resistance⏎Types
-
• Describe the capital budgeting process⏎• Understand and apply the following capital budgeting techniques:⏎o Payback period⏎o Net present value⏎o Internal rate of return<|endoftext|>Becoming a Reader: A Developmental Approach to Reading Instruction (
-
heated back up to room temperature before it is released back to the air conditioned area.⏎Relative humidity – the moisture contained in any given air mass relative to the temperature of that air. Homes have a HVAC device (heat, ventilation, and air conditioning
-
cence. The glow becomes yellow as the temperature is lowered and orange-red at the temperature of liquid air.⏎Fluorine is reported to react with radon, forming
-
such as shredded bark or compost to help keep the soil at a consistent temperature. Spread mulch from the main stem out to a foot or so
-
to or at the speed of light, this would cause them to gain near-infinite mass, according to the laws of relativity.⏎For example, the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The amount of money amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels amount levels
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ettlement, the average age of these children in 2004 was only 15 years old, with 79% of the children between the ages of 15–18 and 20% under the age
-
. For a 160 pound man, that translates to 72 to 109 grams of protein per day, which is well within the recommended range (10-35 percent of calories).⏎- Type of protein:
-
several serious health complications and diseases. The American Heart Association reports that most Americans consume an average of 22 grams of added sugar per day, much higher than the recommended 6 teaspoons for women and 9 teaspoons for men. University
-
rates, has been hovering around this level since the late 1990s.⏎- For more than thirty years, the total fertility rate has been below the replacement level (which is currently approximately 2.1 children per woman). This
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:576 excites
- L18:1176 suppresses
- L15:2300 suppresses
- L16:1676 excites
- L20:698 suppresses
- L19:1454 weakly excites
- L19:2203 weakly suppresses
- L21:1433 weakly excites
- L19:1614 weakly excites
- L8:1861 weakly excites
- L18:2157 weakly excites
- L10:34 weakly excites
- L5:1172 weakly excites
- L10:2012 weakly excites
- L21:343 weakly excites
- L13:2054 weakly suppresses
- L20:3067 weakly excites
- L19:2005 weakly suppresses
- L12:944 weakly excites
- L10:212 weakly excites
- L0:2126 weakly excites
- L3:2921 weakly suppresses
- L15:856 weakly suppresses
- L0:518 weakly suppresses
Feeds later layers
- L26:528 strongly suppresses
- L27:758 suppresses
- L25:646 suppresses measurement words before a value
- L23:142 excites
- L27:3014 suppresses
- L25:998 suppresses
- L24:1228 suppresses
- L27:2815 weakly suppresses
- L24:2531 weakly suppresses
- L25:800 weakly excites
- L23:745 weakly excites
- L23:2296 weakly suppresses
- L24:1857 weakly suppresses
- L23:791 weakly suppresses
- L24:827 weakly suppresses
- L25:407 weakly suppresses
- L27:735 weakly suppresses
- L24:1871 weakly suppresses
- L23:2137 weakly suppresses
- L24:2362 weakly excites
- L23:413 weakly excites
- L24:1015 weakly suppresses
- L26:2643 weakly suppresses
- L24:428 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ault
- 党组书记
- oucher
- Effect
- ivers
- walk
- 着眼
- uator
- ifter
- 着手
Suppresses
- amount
- level
- 级别
- 金额
- depth
- levels
- status
- date
- 价格
- level