capital D starting a split word
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to a capital D that starts a fragment of a longer word, such as the 'D' in 'DPFs', 'Domicile' or 'Drowning'. Turning it up or down made the model's writing wander or repeat, without a clear link to the letter.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to remove soot from diesel emissions in 1978, just a few years after the famed catalytic converter substrate. But like many environmental technologies, DPFs were initially viewed as an unnecessary luxury since diesel engine manufacturers easily met the
-
choice continues until the acquisition of another domicile of choice.⏎1. Domicile of choice: acquire when abandon previous domicile, arrive in the new domicile
-
drug discovery for vaccines⏎- Addressing the challenges of applying micro/nano technology for COVID-19 diagnosis, vaccination, or therapy.⏎Xuexin Duan, School of Precision Instrument and Opto-electronics Engineering, Tianjin University
-
scream for help. They will be using every bit of energy they possess to try and get air, if they are even able to get their face above water. Drowning is often a silent killer. Be aware of an expression of panic or concern
-
see how Southern Ute is using natural resources to advantage the tribe. We think they're doing well as far as adapting with the times,” said Navajo member Dailan Long, whose family lives near the Navajo Mine that is close to
-
two spacecraft. This system is currently being incorporated into the design of Mini AERCam vehicle.⏎This work was done by Nathan Howard of Johnson Space Center and Hai D. Nguyen of Lockheed Martin Corp. For further information, access http://aerc
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: each individual causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even causes each causes even
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
without knowing. That is easy. How you get to know is what I want to know.⏎The above quote also reminded me of the Voltaire quote: “Doubt is not a pleasant condition, but certainty is absurd.”<|endoftext|>What is
-
| Fallon, Kevin. "Gabby Douglas, Ryan Lochte: Why Families of America's Olympics Athletes Are Broke." The Daily Beast. Newsweek/Daily Beast, Web. 20 Aug. 2012⏎
-
due to the Aizoaceae (Ice Plant Family), Asteraceae (Daisy family) and Campanulaceae (Bellflower Family).⏎The activity
-
NBC), "Ally McBeal" (FOX), "That '70s Show" (FOX), "The Simpsons" (FOX), and "Dawson's Creek" (FOX). Taylor said these programs were chosen because they
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:400 excites
- L10:180 excites
- L5:196 suppresses the 'D' in vitamin D
- L17:300 suppresses
- L0:233 excites
- L18:105 suppresses
- L21:1912 excites
- L22:1511 suppresses
- L19:526 suppresses
- L2:110 excites
- L20:200 excites
- L23:206 suppresses
- L1:773 excites
- L19:372 suppresses
- L4:1373 suppresses
- L26:581 excites
- L6:13 excites
- L20:1120 excites
- L26:1564 weakly excites
- L1:10 weakly excites
- L18:569 weakly excites
- L8:7 weakly excites
- L22:473 weakly suppresses
- L22:530 weakly suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- _literals
- fold
- tabpanel
- 啰
- 样的
- organizer
- específ
- 税务局
- specifically
- supporter
Suppresses
- oe
- onation
- ชอบ
- rew
- omination
- midfield
- yssey
- .controls
- anship
- iane