quantity words like 'one', 'more', 'amount of'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words that measure how much or how long, such as 'one', 'more', 'amount of' or 'percent of', right before the thing being measured. It goes slightly negative on words like 'at' or 'a' in plain physical descriptions. Turning it up made the model repeat phrases about the newspaper or temperature, which does not clearly match the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
converts rotary motion into linear motion.⏎The ‘lead’ of a Lead Screw is the distance which a Lead Screw Nut will move during one 360° rotation of the screw. A smaller Lead results in a
-
repeating event per unit time. It is also referred to as temporal frequency, which emphasizes the contrast to spatial frequency and angular frequency. The period is the duration of one cycle in a repeating event, so the period is the reciprocal of the frequency.⏎
-
through which these beliefs have been given to us, but also a guide for our present worries and undertakings, is not so common. It takes a lot more reflection (and life experience) to realize the rules and ideas about behavior we have
-
in thermal runaway and over-current conditions. Protection circuitry is straightforward and easy to implement but adds to the bill-of-materials (BoM) and takes up more space
-
body of harmful toxins.<|endoftext|>Object-oriented editing means the ability to edit and/or process individual objects, such as a MIDI or audio clip — whether they last the entire length of a song or only a few milliseconds. This is a different way of
-
proportional fonts, in which different characters have different widths.⏎In the monospaced example above, a wide character (like “m”) takes up the same amount of space as a thin character (like “i”).⏎Monospaced type looks
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: when I have a day's worth of work, and the day's worth of work is not enough, you have to put up a day's worth of work in a month's worth of days worth of months, or you have to be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
RF) waves are a form of electromagnetic energy. They move through space at the speed of light and can be man-made or occur naturally. They move through space at the speed of light and can be man-made or occur naturally
-
molecular clock.⏎DNA is the giant molecule in each of our cells that holds the architectural plan of our body and physical functions. Over the generations, DNA changes at a presumably steady rate. For birds, that's about 2% change (for
-
unit types are: DECIMAL, SCIENTIFIC, ENGINEERING, ARCHITECTURAL, FRACTIONAL. The ‘precision’ section allows you to pick the number of decimal places for your dimensions. If you are doing a project for
-
Countess of Rosebery, died, at Dalmeny House, in Scotland, at the age of 39. As the only child of Meyer de Ams
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:1693 suppresses
- L17:2607 suppresses
- L18:1412 excites
- L15:97 suppresses
- L15:1521 excites
- L14:258 excites
- L18:1348 suppresses
- L18:1176 weakly suppresses
- L18:1315 weakly excites
- L17:673 weakly excites
- L18:1304 weakly suppresses
- L18:573 weakly suppresses
- L17:2588 weakly excites
- L17:1895 weakly suppresses
- L16:576 weakly excites
- L18:948 weakly excites
- L16:2968 weakly suppresses
- L16:556 weakly excites
- L17:209 weakly excites
- L18:618 weakly excites
- L13:1978 weakly excites
- L12:602 weakly suppresses
- L18:2718 weakly excites
- L18:2846 weakly suppresses
Feeds later layers
- L22:1310 excites
- L20:988 excites
- L20:2734 weakly excites
- L20:695 weakly excites
- L23:161 weakly suppresses
- L20:731 weakly excites
- L25:2969 weakly excites
- L25:1286 weakly suppresses
- L27:335 weakly excites
- L20:1038 weakly suppresses
- L20:599 weakly suppresses
- L20:581 weakly suppresses
- L23:1247 weakly suppresses
- L27:2452 weakly excites
- L21:908 weakly suppresses
- L22:660 weakly excites
- L21:2851 weakly suppresses
- L27:1780 weakly suppresses
- L22:1679 weakly excites
- L21:708 weakly suppresses
- L21:2171 weakly excites
- L24:1368 weakly suppresses
- L22:2563 weakly excites formal document and standards citations
- L20:2482 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- tape
- liga
- Pager
- �
- crib
- igar
- bubb
- transformer
- transformers
- Spreadsheet
Suppresses
- 年年底
- otland
- 年底
- .distance
- oted
- _bonus
- engeance
- 郢
- _FAMILY
- offseason