'at' in 'at least' and 'minimum'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'at' when it comes before 'least', as in 'at least 70%', and it leans toward the idea of a minimum. When it was turned up, the model kept bringing up the word 'minimum'.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of dog food, but all of them must meet certain requirements to be considered “real” dog food. For example, the food must have a meat content of at least 70% and it must not contain any artificial colors or flavors.
-
across disparate operating systems.⏎Kubernetes clusters are actually a set of nodes categorized into master nodes and worker nodes. Every cluster needs to have at least one of each. While the master node is meant to control the state of
-
least twenty-five years old upon assuming office. No person can serve as attorney general unless he or she has been an active member of the State Bar of Georgia for at least seven years.⏎The role of attorney general has been considered crucial from the outset
-
whose skeletal structures are still in the developmental stage. For them, insufficient vitamin levels can result in rickets and other skeletal malformations. All adults must get at least minimal levels of vitamin D to absorb sufficient calcium to maintain healthy bones. Post
-
drum is only one portion of being a drummer for most jazz, country and western, rhythm and blues, and rock and roll bands. A drum set generally features at minimum, one snare, two toms, a base drum and a high
-
: a minimum age of 16 for a learner's permit; a waiting period of at least six months before a driver with a learner's permit could apply for a provisional
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to make a complex yet beautiful, yet still open to change. What does that mean to you, or might it be unlimited, unlimited, unlimited? In the form of an article, can you make an article about this concept? In
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
countries adopted the Paris Agreement, an international treaty on climate change, a precursor to the Glasgow conference. These countries have agreed on a goal of limiting global warming to an increase of 2 degrees Celsius, and preferably 1.5 degrees Celsius,
-
test the motor windings for continuity. If the windings do not have continuity, replace the evaporator fan motor.<|endoftext|>A fraction is a number that has a specific value. The percentage value
-
regulated by the U.S. Environmental Protection Agency (EPA). In 1986, EPA established a maximum allowable concentration for fluoride in drinking water of 4 milligrams per liter (mg/L), a guideline designed to prevent the public
-
2015). Loma Linda University Electronic Theses, Dissertations & Projects. Paper 294.⏎Loma Linda University Electronic Theses and Dissertations⏎Loma Linda University. Del E. Webb Memorial Library.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2348 strongly excites "at least" and minimum-quantity phrases
- L16:2990 excites
- L20:425 suppresses
- L19:1171 excites
- L15:1910 excites
- L15:1963 excites
- L17:2887 excites
- L12:2847 excites
- L21:1558 suppresses
- L12:2102 suppresses
- L22:999 suppresses
- L21:1977 suppresses
- L21:725 excites
- L13:1711 suppresses
- L22:1104 weakly suppresses
- L21:1324 weakly suppresses
- L17:2568 weakly excites
- L21:1001 weakly excites
- L22:3027 weakly suppresses
- L11:1048 weakly excites
- L17:2446 weakly suppresses
- L21:544 weakly excites
- L18:2148 weakly excites
- L7:1387 weakly excites
Feeds later layers
- L27:863 strongly excites
- L24:812 strongly excites
- L25:2221 excites
- L27:1127 excites
- L25:1182 excites
- L24:748 suppresses
- L26:1951 suppresses
- L27:1711 weakly excites
- L24:1197 weakly excites
- L27:1465 weakly excites
- L27:2173 weakly excites
- L26:910 weakly excites
- L27:1060 weakly suppresses
- L26:2537 weakly excites
- L24:2125 weakly excites
- L24:814 weakly suppresses
- L27:1525 weakly excites
- L25:2378 weakly excites
- L24:3005 weakly suppresses
- L25:2870 weakly suppresses
- L27:2665 weakly excites
- L26:2034 weakly excites
- L25:982 weakly suppresses
- L25:2700 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- min
- min
- minimum
- -min
- 最小
- _min
- (min
- Min
- .min
- ,min
Suppresses
- strup
- unlimited
- maxi
- 宏大
- ionate
- getMax
- ecture
- opic
- maximize
- peaked