"of" in titles and set phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word "of" in fixed phrases such as "Table of Contents" and "Town of," and in phrases like "crisis of" or "level of." Turning it up didn't produce a clear change in topic in the sample outputs.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
3 | 240 pages | Cloth $55.00⏎American History / Women's Studies/Gender Studies⏎View main book page⏎Table of Contents⏎Chapter 1. Sleep Is for Sissies: Elite Males
-
suggested the name “Town of Stinnett” in honor of A.S. Stinnett, and this
-
Do not use your browser's "Refresh" button). Please email us if you're running the latest version of your browser and you still see this message.⏎Table of contents⏎Bluetooth is an industrial specification for wireless data transfer. Bluetooth connectivity is often
-
these jobs. Each chapter offers exercises, links to videos and websites, review quizzes, and suggested readings to learn more about the creation and production of theatre.⏎Table of Contents⏎- PRODUCTION AND BACKSTAGE ORGANIZATION⏎- PROD
-
ens back to a world-wide quasi-revolution in law from 100 years ago, called by many at the time, the solution to “a crisis of democracy.” Today, that approach may herald a new period of legal transition as recent
-
Symposium, his theory of intellectual development as the standard contemporary treatment of deductive reasoning is used as the context in which the contributors elaborate on their own perceptions.⏎Table of Contents⏎Contents: W.F. Overton, Competence and Procedures: Constraints
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The process is given as 1,2,3,4,5,6,7,8,9,10,12,13,14,15,16,17,18
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
balancers.⏎The chemical name of pool "Stabilizer" is Cyanuric Acid and is commonly referred to by either name. The Stabilizer level of swimming pool water must be maintained at 30-50 ppm. The
-
, which is based on taste and odor thresholds. In fact, less than 1 percent of samples included in the USGS studies exceeded the EPA consumer advisory concentration of 20 micrograms per liter. Still uncertain, however, are possible human
-
of a fire, spill, or other hazard into the laboratory. Sliding sashes should not be removed from horizontal sliding sash hoods. The face opening of the hood should be kept small to improve the overall performance of the hood. If
-
. They are developing an electric car that will break – no, shatter – the existing E-1 class electric land speed record of 204 mph. By combining aerodynamics with new, cutting-edge green
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:367 excites
- L2:568 weakly excites
- L1:2340 weakly suppresses
- L3:927 weakly suppresses
- L2:1599 weakly excites
- L2:3026 weakly suppresses
- L1:912 weakly suppresses
- L1:679 weakly suppresses
- L1:403 weakly excites
- L1:2993 weakly excites
- L2:803 weakly suppresses
- L1:2518 weakly excites
- L3:45 weakly excites
- L0:2744 weakly excites
- L2:995 weakly suppresses
- L1:919 weakly excites
- L3:477 weakly suppresses
- L2:501 weakly excites
- L2:1171 weakly suppresses
- L1:43 weakly suppresses
- L1:2353 weakly suppresses
- L0:1644 weakly excites
- L0:40 weakly suppresses 'of' in 'sort of' hedges
- L1:312 weakly excites
Feeds later layers
- L7:674 excites
- L6:136 suppresses
- L13:440 weakly excites
- L8:2782 weakly suppresses
- L23:39 weakly suppresses
- L8:419 weakly excites
- L11:399 weakly excites
- L18:3027 weakly suppresses
- L23:2784 weakly excites
- L9:130 weakly excites
- L17:1725 weakly suppresses
- L14:2198 weakly suppresses
- L16:1119 weakly excites
- L19:789 weakly suppresses
- L15:762 weakly excites
- L17:1160 weakly excites unclear: inside numbers and names
- L14:270 weakly excites
- L26:658 weakly suppresses
- L8:349 weakly excites 'of' inside title-like noun phrases
- L14:2863 weakly suppresses
- L15:2778 weakly excites
- L17:1686 weakly excites
- L5:550 weakly suppresses
- L6:1569 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- special
- بار
- same
- arena
- "><!--
- ですよ
- uf
- c
- interval
- Wilmington
Suppresses
- YPD
- ادات
- orro
- 淖
- ponse
- enne
- ennes
- _Column
- .setColumns
- ủ