'of' linking a category to its parent field
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' (or 'within') when it links a specific thing to a bigger group it belongs to, like 'a subfield of algebra' or 'a subset of hash functions'. When turned up, the model's text drifted toward maths and abstract topics.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
classically Diophantine geometry), a subfield of algebraic number theory.⏎- The study of the real points of an algebraic
-
functions are generaelly a subset of hash functions that fulfil at least two extra criteria:⏎In order to fulfil these criteria
-
a subgroup of the N numbers.⏎Another mystery was solved in researching this class. At the Brid
-
.<|endoftext|>Archive for the ‘transcendental geometry’ tag⏎The modern mathematician finds the space of three dimensions, in which our visible universe is containled, entirely too contracted for his
-
based in the Northwestern United States, provided for U.S. government customers, complementing existing government agencies already using the US East Region. Each Region is wholly contained within a single country and all of its data and services stay within the designated Region.⏎
-
get to normal subduing the demand. The government starts to deepen the pocket by increasing taxes,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: What is the name of the new type of car and what is the impact of the environmental movement? I don't know what to do with the old cars. The old cars have a very high impact on the environment. This is the case
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to explore STEM topics in a way that deepens their knowledge while also developing 21st-century skills.⏎Read the rest of this entry »⏎Filed under: Gaming, Services, Software, 3 million dollar grant, Associate Professor, Aug
-
in running a safer and quicker service.⏎- (Side effect) improved passenger movement will help to reduce larger crowds and subsequently improving safety.<|endoftext|>This article was submitted by a member of our State Climate Policy Network (SCPN) — a rapidly-growing
-
flanked by terraces for farming.⏎The stone for the buildings was mined from a quarry and shaped using bronze tools, then smoothed with sand in order to fit tightly together. No mortar was used in the construction. Even after many centuries of wear
-
bright, mocking beauty.⏎October 2003 | Volume 54, Issue 5⏎Your example of occupy brings to mind the way in which new words are
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:2820 suppresses
- L5:60 excites
- L5:1477 excites
- L2:1036 excites
- L4:1738 weakly suppresses
- L2:1634 weakly suppresses
- L5:158 weakly suppresses
- L1:1464 weakly excites
- L1:1064 weakly suppresses
- L2:2692 weakly excites
- L5:1673 weakly suppresses
- L5:110 weakly suppresses
- L3:2282 weakly suppresses
- L3:2330 weakly suppresses
- L1:1225 weakly suppresses 'domain' after time or frequency
- L2:49 weakly suppresses
- L0:2748 weakly excites
- L1:2683 weakly excites
- L1:1852 weakly suppresses
- L2:596 weakly excites
- L5:86 weakly suppresses
- L2:2460 weakly excites
- L5:28 weakly excites
- L5:50 weakly excites
Feeds later layers
- L8:2256 excites
- L9:2566 excites
- L11:2292 weakly excites 'than' in comparisons
- L20:1481 weakly excites
- L19:2015 weakly excites
- L13:2573 weakly excites
- L17:1574 weakly excites
- L7:705 weakly suppresses
- L17:2959 weakly excites
- L10:2133 weakly excites
- L10:114 weakly suppresses
- L15:1355 weakly excites
- L10:544 weakly excites
- L23:2863 weakly suppresses
- L12:2367 weakly suppresses
- L15:2401 weakly suppresses
- L15:254 weakly excites
- L16:1618 weakly suppresses
- L8:2196 weakly excites comparison words like more, same, but
- L12:2289 weakly excites 'of' after part-whole nouns
- L9:2613 weakly suppresses
- L10:2966 weakly excites
- L7:1858 weakly excites
- L8:2070 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- isci
- โรงแรม
- 得住
- abinet
- criptive
- isi
- ligne
- nghi
- 躺着
- isiert
Suppresses
- puted
- mittel
- pdata
- ма
- ��이
- mitters
- newY
- etermination
- 税务总局
- letal