capital B starting a name or citation
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to a capital B at the start of a word or name, often a surname inside a citation like '(Beggs et al.)' or a nationality like 'Burmese'. Turning it up made the model's text fall into repeated filler words like 'even even', which is not related to the letter.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Zarwani” beliefs, annually on Bahman 22 (February 11). Other names for this feast are “Badra” or “Bazoreh.⏎Background of Badrouzi Festival⏎In the calendar of ancient
-
Paper wasps (Hymenoptera: Vespidae) are widely distributed around most of the globe and are diverse and common in many landscapes (Beggs et al., 2011). Paper wasps are likely
-
London—A Visit from the Grave—Effect of the Dissolution on the Charterhouse Priory—The Charterhouse and the Howards—Thomas Sutton—Bishop Hall's Letter and its Effect—Sutton's Death—Baxter's
-
70, fem. as the Av. word), Chor. γrīw (γryw) “soul, body, self” (Benz
-
a 1911 census, 25 percent of female suffrage leaders were journalists or authors, the highest-represented profession among the group (Bacchi 6).⏎In an interview
-
ue healthy behavior in terms of dependency on a medical industry that constantly invents not only new cures, but new diseases for the cures it already possesses (Blech, 2006).⏎Empty language is like empty calories.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:itititititititititititititititititititititititititititititititititititititititititititititititit
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
performance in the 14thCritical Assessment of<|endoftext|>Researchers Show Impaired Muscle Function from Antibacterial Chemical, Call on Regulators to Reconsider Consumer Uses⏎(Beyond Pesticides, August 16, 2012)
-
your toddler entertained.⏎You know how geoboards are useful for strengthening little fingers? Well, they will surely enjoy making their own versions of a crazy DIY geoboard.⏎Music is always fun! And now you can make a homemade string instrument
-
of the Environment at Western Washington University.⏎The Northwest Advanced Renewables Alliance (NARA) Education group aims to:⏎- Meet the workforce needs of the bio-energy/bioproducts economy⏎- Develop a broad, integrated view of the bio
-
plant hormones on a plant by growing an new plant from a simple leaf cutting⏎These are the materials needed to grow your own plant:⏎-African violet leaf*⏎-Bottle or jar⏎-Water-soluble plant fertilizer (an general fertilizer will
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:1476 strongly suppresses
- L18:242 excites
- L22:2245 excites
- L21:1582 suppresses
- L20:256 excites
- L2:1855 excites
- L7:520 suppresses
- L16:67 suppresses
- L19:583 excites
- L18:385 excites
- L1:4 excites
- L3:516 suppresses
- L21:706 suppresses
- L20:558 weakly suppresses
- L5:1723 weakly suppresses
- L23:206 weakly suppresses
- L6:328 weakly suppresses
- L19:251 weakly excites
- L17:517 weakly excites "but" in "not only X, but" phrases
- L6:1357 weakly excites
- L4:1319 weakly excites the 'B' in vitamin B
- L4:122 weakly suppresses
- L18:102 weakly suppresses
- L4:309 weakly suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- even
- 任何人
- 更何况
- 协会会员
- 客户提供
- оля
- Respond
- <Map
- ながら
- 立马
Suppresses
- it
- eat
- est
- uy
- ig
- tn
- UF
- its
- rut
- uf