'a' or 'an' before a noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the small word 'a' or 'an' when it comes right after a preposition or verb, as in 'a variety of' or 'based on a'. When it was turned up, the text drifted into vague, generic wording, but the steered outputs did not clearly pick up the article theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
on the Atwater factors:⏎Fat: 9 cal/g Carb: 4 cal/g Protein: 4 cal/g⏎- Percent Daily Values are based on a 2,
-
ACS Nano.<|endoftext|>Regulating intestinal bacteria helps improve an individual’s stress status: that’s the conclusion reached recently by researchers from Shanghai University
-
herbal compounds, meditation, massage, and cleansing therapies. The people that practice Ayurvedic medicine claim that it prevents illnesses, treats serious health conditions and contributes to a healthy and long life.⏎The basic belief behind Ayurvedic medicine is that all
-
as Synodontis mossambica, Synodontis ornatus, Synodontis multipunctatus, and so on; some species are also farmed on a commercial scale as food or bait fish in some areas of Africa and Asia.⏎More
-
another over-the-counter medication to help combat nausea. Diphenhydramine (benadryl) is often helpful in treating nausea, motion sickness and a variety of skin issues. Dramamine or Bonine are also useful for dogs suffering
-
- Globally, 10-20 million people work in the ASGM sector and many of them use mercury on a daily basis.⏎- Countries from Africa, Asia-Pacific and the European Union too have
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: maybe I should have thought about something that is not just a regular math problem. So I decided to try something that are not regular math problems. So I decided to think about math problems that are not regular math problems. So I decided to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
for enjoyment as well as knowledge. The book started life as a series of five-minute radio broadcasts and for this reason its conversational style feels more like a series of fireside chats than a regular college textbook. Those radio broadcasts were highly acclaimed and
-
to Cape Lookout.<|endoftext|>Posted by Marcus on .⏎An ideal monatomic gas initially at 298 K and 1 atm pressure is⏎expanded from a volume of 1 liter to 2 liters. Consider separately⏎isobaric
-
911. It consists of about 200 buildings, which include dwellings and temples, a central plaza and a royal palace, all flanked by terraces for farming.⏎The stone for the buildings was mined from a quarry and
-
consequently took up arms.⏎At the Silveira farm near Punta Brava, Bandera made his last stand with twenty of his followers. He was surrounded by troops led by General Freyre Andrade, and a group of Rural Guards stormed
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2509 excites
- L6:640 excites "the" introducing a noun phrase after a name or preposition
- L6:1588 excites
- L4:137 excites
- L0:173 excites
- L7:385 suppresses
- L1:1062 suppresses
- L6:426 excites
- L4:1374 excites
- L5:457 suppresses 'a' after 'tell', 'bring' or 'much of'
- L5:249 weakly excites "a" right after "as"
- L5:1434 weakly excites
- L3:1810 weakly excites
- L7:7 weakly excites
- L4:2589 weakly suppresses
- L6:61 weakly suppresses
- L4:1573 weakly excites
- L3:787 weakly suppresses
- L6:1655 weakly suppresses "a" or "an" after "such" or launch verbs
- L7:121 weakly suppresses
- L4:326 weakly suppresses
- L6:806 weakly excites
- L4:2473 weakly excites
- L7:159 weakly suppresses
Feeds later layers
- L9:459 suppresses
- L14:313 excites
- L12:652 suppresses
- L10:578 suppresses
- L16:284 suppresses
- L9:59 suppresses "a" meaning per (a day, a year)
- L11:294 suppresses
- L14:1659 excites
- L24:150 suppresses
- L14:1402 suppresses
- L19:832 suppresses
- L13:975 weakly suppresses
- L19:183 weakly excites
- L18:2301 weakly suppresses
- L16:340 weakly suppresses
- L13:2325 weakly suppresses
- L12:72 weakly suppresses
- L9:330 weakly suppresses gap where a number was removed
- L13:1320 weakly suppresses
- L20:94 weakly suppresses
- L19:2119 weakly suppresses
- L17:935 weakly excites
- L11:2152 weakly excites
- L16:896 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 做一个
- 印
- 果
- 作
- igua
- 体
- 报告
- ium
- 突
- 扰
Suppresses
- социально
- tsky
- .bundle
- lsen
- ensch
- ynchronously
- ationally
- zier
- 共产党员
- geführt