'of' or 'a' in evaluative noun phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the small words 'of' and 'a' in phrases like 'a wisp of a man', 'the simplest of moments' or 'a beast of a task', where a describing word is linked to a noun by 'of'. It is quieter when 'of' is used to measure an amount, such as 'minutes of activity'. Turning it up did not produce a clear theme in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
: "We watched trucks unload sacks of flour into crowds that hadn't eaten in three days. I can still see Schim [sic], a wisp of a man, standing on the jeep silhouetted against the darkling sky quietly
-
at the clang of a bell and out of the mill by the clang of the bell—into the mill and at work in obedience to that ding-dong of a bell—just as though we were so many machines.”⏎–The Belles of
-
into groups, pass out the game boards.⏎- Attempt to explain to students how to properly pronounce and say dates in English:⏎Once you have got that beast of a task taken care of, simply tell the kids to play "sug
-
accomplished or when friendly exchanges are made. Begin to ECSEL teachers make an effort to model gratitude to our students whenever we can. This can happen in the simplest of moments, like when our
-
, are published in a Special Report in the August issue of The Lancet Oncology.⏎Source: Medical News Today<|endoftext|>It’s hard for even the most rigorous of scientists to argue with an elegant experimental design and a pretty result. But all too
-
profound concern for the interests of future generations.⏎It is important to note that our ancient ancestors raised the question of sustaining the world as an ethical obligation in the earliest of times. It develops as a discourse and moral duty in the ethical imperative of ser
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the new user experience on a personal computer? The user experience on a personal computer desktop Windows Live Earth Windows Vista Ultimate** **Mac Ares Awards ARES Awards ARES ARES ARES ARES ARES ARES ARES
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
dietary guidelines recommend adults do at least 30 minutes of moderate intensity physical activity – such as brisk walking, social tennis or swimming – on
-
the bass clave.⏎The music notes themselves are written as small dots, or small dots with ascending or descending lines attached.⏎To learn these notes takes a few days of intense work (yes, work!); but it is really worth the effort because
-
among adults in the United States are somewhat shocking. According to recent studies, some 35% of adults do not get the CDC recommended minimum of seven hours of sleep per night, and adults over the age of 65 are often plagued
-
general. But for black and Hispanic students in lower-income urban neighborhoods, a fast food restaurant a mile nearer to school canceled out the benefits of up to three days of exercise each week.⏎According to the researchers, they published in the current issue of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:2863 excites
- L7:23 weakly suppresses
- L8:9 weakly excites
- L4:605 weakly suppresses
- L8:361 weakly suppresses
- L3:753 weakly suppresses
- L1:169 weakly suppresses
- L8:58 weakly suppresses
- L8:771 weakly suppresses unclear: 'of' after a quantity noun
- L3:486 weakly excites
- L7:2183 weakly suppresses
- L2:820 weakly suppresses
- L5:2527 weakly excites
- L0:331 weakly suppresses
- L3:2603 weakly suppresses
- L6:1024 weakly excites
- L0:1700 weakly suppresses
- L3:1053 weakly excites
- L6:3052 weakly suppresses
- L8:602 weakly excites
- L1:1391 weakly suppresses
- L1:1967 weakly excites
- L6:2793 weakly excites
- L7:814 weakly suppresses
Feeds later layers
- L19:1620 suppresses
- L24:108 excites
- L14:1402 suppresses
- L12:372 excites
- L12:656 excites
- L19:515 excites
- L21:368 excites
- L11:624 weakly suppresses
- L18:2629 weakly excites
- L17:2192 weakly suppresses
- L16:715 weakly excites
- L13:2634 weakly suppresses
- L17:1943 weakly suppresses
- L17:403 weakly excites
- L19:914 weakly excites
- L17:1638 weakly suppresses
- L17:1858 weakly suppresses
- L19:709 weakly suppresses
- L16:1855 weakly suppresses
- L17:940 weakly excites
- L25:2672 weakly suppresses
- L19:2388 weakly suppresses
- L19:2099 weakly suppresses
- L20:318 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 二字
- пара
- reements
- 办好
- 放过
- 大片
- 个小
- pane
- 方
- ��
Suppresses
- olate
- anoia
- ;⏎
- ulsive
- ];⏎
- ustum
- ;$
- ;*/⏎
- ushed
- acional