number theory terms like 'number' and 'Gauss'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on maths words, especially 'number' in phrases like 'algebraic number theory' and the name Gauss. When it was turned up, the model's writing drifted toward maths problems about multiples and common factors.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
classically Diophantine geometry), a subfield of algebraic number theory.⏎- The study of the real points of an algebraic variety is the
-
als. The quadratic residue Gauss walk exhibits a more complex behavior whose shape is roughly determined by the remainder of modulo
-
, takes steps given by the terms of the exponential or quadratic residue Gauss sum modulo , and ends at the value of the Gauss sum. By a famous result of Gauss, if the modulus is a prime number, the two walks always end at the
-
with coordinates in an algebraically closed field.⏎- The study of the points of an algebraic variety with coordinates in the field of the rational numbers or in a number field became arithmetic geometry (or more
-
by different equations.⏎Algebraic geometry occupies a central place in modern mathematics. The concepts it uses connects it to such diverse fields as complex analysis, topology and number theory. At the start, algebraic geometry was about studying systems of polynomial equations
-
ured members. Similarly, our estimate predicts 2.5 members starting from 86. It is easy to check that the sequence doesn’t contain any more numbers below 200 and our estimate predicts 0.07 members after
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the name of this? I need to put this in the document, please, I need to refer to the specific sentence, what is the process of doing this, how the data is collected and used in this document, what the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
how to keep them from destroying your landscape.⏎Symptoms Of Oak Spider Mites:⏎Spider mites cause damage by sucking cell contents from the leaves. You most likely will not notice anything odd when m
-
Xyleborus glabratus.⏎Adult females construct galleries in the sapwood and inoculate the galleries with a fungus (Ophiostoma sp., vascular wilt pathogen). The adults and larvae feed on fungi and not on the wood of
-
. In 1981, Chile was officially declared FMD-free without vaccination, after complying with all international health requirements.⏎Foot-and-mouth disease (FMD) affects mainly swine and related wild ruminants and is characterized by so
-
ured at the base, where bees occasionally bypass their pollination task by biting through the flower wall to “rob” the nectaries. Watch too for bees landing on discolored leaves and licking them; this behavior transmits Monilinia
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:1047 excites
- L6:737 suppresses
- L6:1177 excites
- L6:7 suppresses
- L6:1608 excites
- L6:2420 suppresses
- L8:2577 excites
- L4:2288 weakly excites
- L8:5 weakly suppresses
- L7:375 weakly suppresses
- L6:531 weakly suppresses
- L6:2813 weakly excites
- L6:2943 weakly excites
- L4:2299 weakly suppresses
- L7:2830 weakly suppresses
- L8:2943 weakly excites 'computer' and 'desktop' after device words
- L5:495 weakly suppresses
- L8:3035 weakly suppresses
- L8:3028 weakly excites
- L7:164 weakly excites
- L2:177 weakly excites
- L3:2246 weakly suppresses
- L1:952 weakly suppresses
- L0:2638 weakly suppresses
Feeds later layers
- L10:978 excites
- L10:2187 excites
- L21:1637 excites
- L19:1033 excites
- L16:1848 excites
- L22:2949 excites
- L17:2958 excites
- L21:984 excites
- L20:1583 excites
- L11:2205 excites
- L24:3009 excites
- L22:2867 weakly excites
- L10:2571 weakly excites
- L20:2044 weakly suppresses
- L18:1676 weakly suppresses
- L23:2372 weakly excites
- L20:1929 weakly excites
- L22:2807 weakly excites
- L18:2628 weakly excites
- L20:1203 weakly excites
- L24:2207 weakly excites
- L21:2594 weakly suppresses
- L19:1775 weakly suppresses
- L20:454 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ogenerated
- gcd
- gatsby
- payday
- hoe
- achievable
- Enumeration
- steen
- 修士
- gcd
Suppresses
- _backward
- sigmoid
- iana
- spl
- 抢救
- 崴
- _ALIAS
- jiang
- 熄
- 仪器