period after a middle initial
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop that comes after a single capital letter in a person's name, like the dot in "Mark G. Williams". Its strongest reactions are small. Turning it up or down did not change the writing in any clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Ebell M. Fewer antibiotics for kids' sore throat don't increase rare complications. Accessed February
-
Mark G. Williams and John D. Teasdale helped adapt the MBSR program so
-
, meaning they produce more electricity.⏎- Sunpower panels can be installed on rooftops or on the ground.⏎- Sunpower solar panels<|endoftext|>By Mortimer J. Adler⏎Aristotle (384 - 322 B.C
-
well being.⏎“Dramatic simulation of an lively shooter occasion at college can be anticipated to impress the identical stress response as the actual factor,” mentioned Peter L. Loper Jr., MD, a pediatric
-
ation tuberous, vegetable, melon, crop and indoor products⏎Wayne's Word. Noteworthy Plants. Biology Economic Botany References Armstrong, W. Armstrong, W. Bailey, L.VIDEO ON THE TOPIC: My Trick
-
census will show the Puerto Rico population stabilized around four million, which would imply that reaching the fourth million occurred in less than thirty years.⏎Autor: gf Ana L. Dávila Román⏎Published: September 20,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I will need to keep it in the form of a long time to make sure that it's not a long time for me to be able to use it. So, To prepare a long time for me to be able to use it.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
harvesting or off road for hunting.⏎© 2012 KELOLAND TV. All Rights Reserved.<|endoftext|>Palm oil, an edible vegetable oil rich in saturated
-
986-1990 | 1991-1995⏎The materials in this archive are copyright © The Manitoba Library Association. Reproduction for personal use is permitted only if this copyright notice is maintained. Any
-
Copyright © 1997, by Random House, Inc., on Infoplease.<|endoftext|>This was an introductory lesson I taught to our elementary children last Sunday (
-
in moist, slightly acidic soils; a sandy loam is ideal. False Dragonhead can tolerate both full sun and partial shade.<|endoftext|>Copyright © University of Cambridge. All rights reserved.⏎'The Solid' printed from http://nrich.maths
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:2925 suppresses
- L4:3058 weakly excites
- L4:96 weakly excites
- L0:1624 weakly suppresses
- L7:101 weakly suppresses
- L6:2029 weakly excites row and column words in grids and tables
- L3:770 weakly suppresses
- L6:250 weakly excites
- L5:2465 weakly suppresses
- L2:814 weakly excites
- L4:1255 weakly suppresses
- L0:1617 weakly suppresses
- L3:421 weakly suppresses
- L2:493 weakly suppresses
- L6:1476 weakly excites
- L5:1438 weakly excites
- L4:2284 weakly excites
- L0:1084 weakly suppresses "the" at the start of a fragment
- L2:1626 weakly suppresses
- L2:171 weakly excites
- L5:1657 weakly suppresses
- L7:173 weakly excites
- L2:1657 weakly excites
- L7:35 weakly excites
Feeds later layers
- L12:2803 suppresses
- L19:1506 suppresses
- L14:409 excites
- L13:2792 suppresses
- L14:1067 suppresses
- L16:1112 suppresses
- L12:1062 weakly suppresses
- L12:792 weakly excites
- L11:23 weakly suppresses
- L10:478 weakly suppresses
- L18:693 weakly excites
- L9:25 weakly excites
- L13:2580 weakly excites
- L18:227 weakly excites
- L9:12 weakly excites
- L17:1770 weakly suppresses
- L13:1578 weakly excites
- L9:103 weakly suppresses "as" or "since" giving a reason
- L16:760 weakly suppresses
- L17:143 weakly suppresses
- L17:1115 weakly suppresses
- L16:319 weakly suppresses
- L19:2073 weakly suppresses
- L10:612 weakly suppresses full stop ending boilerplate or a title
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ATUS
- ITLE
- すれば
- 璋
- lude
- oked
- ended
- rella
- ...]⏎⏎
- orna
Suppresses
- tics
- although
- quil
- .getLength
- 有时候
- DateTimeKind
- nero
- riers
- 虽然
- landers