'of' in 'of course'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the word 'of' inside the phrase 'of course', mostly when it is set off by commas in the middle of a sentence. The steering results are noisy and do not clearly show a theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
sent to our brain. Our brain then creates the beautiful pictures that we see before us. Our eyes are well-oiled machines (metaphorically speaking, of course).
-
do comment or send me an email @kcl.ac.uk. If I use it you will of course be credited by name in the essay although this will certainly not make you rich
-
of materials and weight and requires something that is much harder to come by: a propellant. You can make your own gunpowder, of course, but refining the process to create effective munitions is as tricky as building
-
opportunities or even just advice. They can connect⏎directly with employers and recruiters who can help them reach their goals faster than they ever thought possible. And, of course, Guru99 notes that online job boards function as the perfect resource for
-
introductory lesson I taught to our elementary children last Sunday ( 2/16/20). We had wonderful dialogue about the passages and stories below, and of course lots of other things! This followed a couple of weeks where we teachers taught
-
the belief that the intention of the author was the one and only correct interpretation of a work. Certainly, there can be other valid interpretations of a work, and of course the literature scholar should not be limited solely to the author, who may have
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: a person a a person a a a a a a a a a a a a a a a a a a a a the a a a a a a a a a the a a a a a a a the a a a a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
common are sinusitis, colds, allergies and a deviated septum. These conditions can cause frequent congestion, which can irritate the membranes and blood vessels of the nose. Medications that are used to treat conditions like sinusitis, cold
-
.⏎First, I want you to consider this story.⏎This story of American history has long been known as the “American dream” story, as the first immigrants of European descent came to this country
-
into eight sections. The pagoda is in the Burmese style. Burmese craftsmen were even brought in to carve all the "accessories" of the pagoda.<|endoftext|>Using electroshock therapy, scientists say it may be
-
collect and thus directly affect the quality of the image you see through the eyepiece.⏎The aperture is so paramount that some suppliers include it directly in the name of their telescope. For example, the PowerSeekr 70az from Cele
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1305 strongly suppresses unclear: verbs after a noun or 'that'
- L18:2271 strongly excites
- L15:632 excites
- L17:790 suppresses
- L17:264 suppresses
- L19:1881 suppresses
- L19:1314 excites
- L19:2449 suppresses
- L18:1601 suppresses
- L17:1167 excites
- L19:1988 suppresses
- L15:785 suppresses 'of' in set phrases like 'of course'
- L19:1024 suppresses
- L15:675 excites
- L19:1182 suppresses 'de' inside Spanish names
- L17:317 excites 'of' after a noun phrase
- L18:277 excites
- L19:766 excites
- L4:1686 excites
- L5:363 excites
- L15:1283 excites
- L18:520 excites
- L18:1588 excites
- L19:1434 suppresses
Feeds later layers
- L22:1124 strongly suppresses
- L22:360 suppresses
- L21:1457 suppresses
- L24:49 excites
- L25:247 suppresses
- L22:353 excites
- L23:24 excites
- L23:157 suppresses
- L27:108 excites
- L22:197 excites
- L26:672 suppresses
- L23:94 suppresses
- L25:525 suppresses
- L21:784 suppresses
- L21:1119 suppresses
- L22:324 suppresses
- L23:1180 suppresses
- L26:693 suppresses
- L21:920 suppresses
- L21:989 suppresses 'the' before a body part or organ
- L24:340 suppresses
- L27:121 excites
- L21:1050 suppresses
- L21:775 suppresses the article 'a' before a noun
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 给她
- İçin
- 的文化
- 在这里
- 所以他
- nét
- 的压力
- Nimbus
- 对她
- 的艺术
Suppresses
- the
- 该县
- our
- each
- this
- 该院
- 各项
- 我国
- 该
- 这家