'of' after 'each' or 'one' or 'all'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows words like 'each', 'one' or 'all', as in 'each one of these' or 'every one of these studies'. Turning it up gave unrelated text, so the steering does not show this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
c) recognise different rhythms. Watch this lesson first for a recap: Reading Music On The Bass Guitar: The Very Basics - Note Names And Locations.⏎Each one of those things is quite easy to do on its own. At first, when you
-
us Mountains. Today, roughly 4,000 Circassians live in Israel, where they constitute the country’s only Sunni Muslim community that sends each of its sons to the military.⏎Read post on Arty Semite blog about Israeli
-
, they’re so rare that Peter Ackerman wrote a children’s book, “The Lonely Phone Booth,” about one of only four remaining outdoor phone booths in all of Manhattan.⏎“I walked past this phone booth every day with my kid when he was
-
port on the station in order to transfer people and material to sustain a space station.⏎Each one of these feats is meant to fit into the long term objective of having a Chinese manned
-
, Roberto Arlt, Alfonsina Storni, and Mário de Andrade, restoring the original newspaper contexts in which their articles first emerged.⏎Each of these writers guided their readers through a constantly changing cityscape and advised them on matters
-
as well as the establishment of a strategic military alliance. The British Embassy in Democratic Republic of the Congo maintains and develops relations between the UK and DRC. Each of Francis' projects was luxuriously decorated both inside and out. Francis was also
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
causes may be purely physiological; maybe nothing is particularly wrong in the teen’s life, but his or her brain just seems to run in a depressed mode.⏎What Are the Signs of
-
incompatible with the Kolmac treatment program.⏎Relapse Sequence Diagram⏎When a person develops a problem with alcohol or other drugs, one of the consequences is that his or her thinking about these substances becomes distorted in a way that perpetuates the problem.
-
your doctor on the alert for symptoms of asbestos–related diseases, which often take decades to develop after the initial asbestos exposure (see asbestosis, mesothelioma, and lung cancer for details).⏎If your asbestos exposure took place during the
-
to get some blood pressure readings at home. In some cases, he or she may recommend that you wear an ambulatory blood pressure monitor. This device measures
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:125 strongly suppresses "of" after all three, both, ten
- L6:972 strongly suppresses "well" after "how"
- L6:1718 strongly excites
- L5:1788 strongly excites
- L6:1782 strongly suppresses 'of' after a category noun
- L6:3016 strongly excites
- L1:818 excites
- L7:2164 excites period inside country abbreviations
- L4:2473 suppresses
- L4:1032 suppresses
- L6:1195 suppresses
- L5:1747 excites
- L6:1063 excites
- L6:376 suppresses
- L6:2785 suppresses
- L4:1743 excites
- L7:111 excites
- L6:2509 suppresses
- L6:2327 excites
- L4:217 excites
- L6:1233 excites
- L7:207 suppresses
- L6:2928 suppresses
- L6:443 excites
Feeds later layers
- L10:167 strongly excites
- L15:557 strongly suppresses
- L17:985 strongly excites
- L11:810 strongly suppresses
- L19:663 strongly excites
- L14:280 strongly suppresses
- L14:2271 strongly suppresses
- L21:716 strongly excites
- L21:274 strongly suppresses
- L16:2520 excites
- L17:1467 suppresses
- L18:602 excites
- L20:519 suppresses
- L18:217 suppresses
- L12:1058 excites
- L13:975 excites
- L20:337 suppresses
- L18:2189 excites
- L21:68 suppresses
- L18:1089 excites
- L18:277 suppresses
- L22:360 suppresses
- L12:372 excites
- L9:820 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- まま
- ものが
- 特点是
- 做法
- 内容
- ことを
- behavior
- 样子
- 行为
- ほうが
Suppresses
- ectomy
- 的情绪
- ously
- entially
- sobie
- otine
- ocese
- @register
- :@"%@
- 的因素