word stems before a suffix, 'dead' negative
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron tends to fire on the first part of a word that is followed by an ending, like 'MSD' in 'MSDS' or 'disput' in 'disputing'. It is strongly pushed down by the word 'dead', as in 'dead elephant' or 'dead ringer'. The turned up text did not show a clear related theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
communicate information on these hazards. The information contained in the SDS is largely the same as the MSDS, except now the SDSs are required to be presented in a consistent user
-
0(g)), revised in 2012, requires that the chemical manufacturer, distributor, or importer provide Safety Data Sheets (SDSs) (formerly MSDSs or Material Safety Data Sheets) for each hazardous chemical to downstream users to
-
0, 2010 - Connecticut teachers visited Quinnipiac University during the summer of 2010 to brush up on classroom technology. The Bristol-Myers Squibb Center for Science Teaching and Learning at Quinnipiac
-
threatened to execute or sell them into slavery. This broadside reassured potential black recruits that the U.S. Government would treat all of its troops as soldiers and retaliate in the event of Confederate mistreatment of black U
-
process known as alternative dispute resolution (ADR). Mediators, also known as arbitrators and conciliators, guide the ADR process and help resolve conflicts between disputing parties.⏎Job Duties of Mediators:⏎Mediators facilitate negotiation and settlement
-
14, 2007 - Scientists Elucidate the Origin of the Darkest Galaxies in the Universe - Press Release⏎-- return to Press Releases --⏎Date Issued: February 14, 2007⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: to make a new life. The only way, and the only way. So I think I think, I think. So I do I do, I do. So I live, I live, I live. So I think I think
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to reduce a⏎dead elephant to nothing more than a pile of bones (see video).⏎remarkable footage
-
coffin with an emergency alarm, intercom, a light, breathing apparatus and a heart monitor in 1995.⏎While urban legend says phrases like “dead ringer”, “saved by the bell” and “graveyard shift” are
-
locust lumber are not common. A wood boring insect often invades the tree. A leaf miner often turns entire hillsides into brown-leafed, “dead-looking” trees for a week or so in the summer, but this damage is
-
80% nitrogen, 16% oxygen, and⏎the rest is a mixture of other various gases.<|endoftext|>WASHINGTON — Scientists predicting the biggest-ever “dead zone” in the Gulf of Mexico are blaming Midwestern corn grown for ethanol for
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L25:2739 suppresses
- L16:269 weakly suppresses
- L10:40 weakly suppresses
- L10:451 weakly suppresses
- L3:2451 weakly suppresses
- L23:2276 weakly suppresses
- L19:2966 weakly suppresses
- L7:1895 weakly excites
- L23:3006 weakly suppresses
- L24:2146 weakly suppresses
- L16:1116 weakly suppresses
- L18:372 weakly suppresses
- L26:798 weakly suppresses
- L23:2869 weakly suppresses
- L25:1459 weakly suppresses
- L24:40 weakly excites
- L13:1376 weakly suppresses
- L11:2823 weakly suppresses
- L23:903 weakly suppresses
- L21:916 weakly suppresses
- L13:2764 weakly suppresses
- L7:2468 weakly suppresses 'real' as opposed to mock or simulated
- L10:1902 weakly excites
- L15:2760 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- чем
- окумент
- �单
- llum
- trif
- Aug
- term
- TouchEvent
- createView
- tro
Suppresses
- ündig
- houses
- fsp
- anst
- Disposition
- enames
- wil
- hint
- ственный
- ively