'of' or 'per' after a quantity noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the small word that links an amount to what it counts, such as 'number of', 'list of', 'goals per match' or 'index starts from'. It is mostly quiet elsewhere, and turning it up or down did not give a clear theme in the sample text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
we will be joining two tables. We read the first table and apply a hash function to each record in the table. These records are then stored in a number of buckets. We then take the records from the second table and apply the same hash
-
define adjacent nodes of a given node as alternate nodes of incident edges. Adjacent nodes are sometimes referred to as neighbors. The degree of a node is the number of its incident edges or
-
has three parts, Part A, short answer, has 1 problem (12 points). Part B has 5 shorter problems (7 points each, so 35 points). Part C has 3 traditional problems (15 points each
-
is time. Each box shows the level of the analogue signal at that instant. Each box is called a 'sample'.⏎A PCM recording is simply a long list of the values of those boxes. Two important determinants of the accuracy of that recording
-
tournament for the first time as Dutch East Indies, now Indonesia, qualified while other Asian teams withdrew.⏎The tournament saw an average of 4.66 goals per match much to the delight of the spectators across the 10 host cities.⏎
-
scale.⏎Items you will need⏎- Calculator with statistical functions⏎Define the bel and decibel. The bel is defined mathematically as LB = log10 (P1/P0) where P1 and P0 are two quanties
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a time where I was in a different kind of situation. I want to describe this situation, and I want to describe the time, and I have a time of similar to this. What is the time is a time of which
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
The development of hydraulic fracturing (‘fracking’) has raised US gas production dramatically, and helped double the estimated global gas resource to around 800 trillion cubic meters (tcm), or 250 years’ consumption at current
-
εσT4⏎where ε=emissivity, a material property; σ = 5.67×10-8 ; T = temperature in Kelvin (absolute
-
|⏎|Year||Equals: Net earnings by place of residence ($000)||% Total||Plus: Dividends, interest, and rent ($000)||% Total||Plus: Transfer payments ($000)||% Total
-
.…⏎Mic level, line level, and speaker level.…Mic level is the weakest of the three.…This is usually somewhere around…a few thousandths of a volt.…Very low voltage.…It can't shock you
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:2534 suppresses
- L13:1782 suppresses
- L14:2805 excites
- L10:1055 suppresses
- L12:1540 excites
- L8:2207 excites
- L12:1726 suppresses
- L6:1407 weakly suppresses
- L14:1989 weakly excites
- L14:1913 weakly excites
- L14:1083 weakly excites
- L10:2333 weakly suppresses
- L12:1141 weakly suppresses
- L8:2413 weakly suppresses
- L14:2008 weakly excites
- L10:659 weakly excites
- L12:2364 weakly excites
- L14:2379 weakly suppresses
- L12:244 weakly excites
- L12:1676 weakly suppresses
- L14:2401 weakly excites
- L11:2380 weakly excites
- L9:2642 weakly excites
- L6:3064 weakly suppresses
Feeds later layers
- L17:2137 suppresses
- L17:2057 suppresses
- L19:2383 suppresses
- L16:1259 suppresses
- L17:2487 suppresses
- L19:862 suppresses
- L17:1168 suppresses
- L16:1121 suppresses
- L16:813 suppresses
- L19:2176 suppresses
- L19:1249 weakly suppresses
- L16:1089 weakly suppresses
- L17:1151 weakly suppresses
- L17:2628 weakly suppresses
- L16:1820 weakly suppresses
- L16:1514 weakly suppresses
- L16:963 weakly suppresses
- L20:2148 weakly suppresses
- L18:2551 weakly suppresses
- L16:403 weakly excites
- L16:2108 weakly excites
- L19:1428 weakly suppresses
- L17:1336 weakly excites
- L17:168 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- .nextLine
- bote
- 突
- Majority
- .random
- groupName
- groupName
- Motorola
- ún
- ellungen
Suppresses
- 他们
- 楔
- icas
- 这是一种
- 他们在
- 说着
- etri
- 影音
- agram
- oram