the letter c splitting a word
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a lone 'c' that starts a word fragment in the middle of a longer word, such as 'c' in 'Portlant-c-ements' or 'c-emeteries'. It tends to go quiet or flip to capital 'C' starts of words like 'Cataracts'. Turning it up made the model's text drift to unrelated topics, and turning it down made it repeat the word 'electric'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
patched up.⏎Closer inspection revealed who was responsible: Azteca alfari, small, sand-colored ants known to build nests inside cecropia trees, which are widespread in Central and South America. Wcis
-
memorials available. Some of the many options to⏎consider include burying the remains in a family burial plot,⏎interring them in an urn garden that many cemeteries have, or⏎placing the urn in a columbarium niche
-
purposes."— Presentation transcript:⏎Types of Portland Cement Different types of portland cement are manufactured to meet various physical and chemical requirements for specific purposes. Portlant cements are manufactured to meet the specifications of ASTM C150. ASTM C
-
first of the nations of the earth.”⏎FUNCTIONS.—The functions of the national government are numerous and important. In adopting the national Constitution, the States delegated or ceded to the United States those powers which are necessary to the strength and greatness of
-
off faint, flickering light, similar to candles. Candles and devices using this oil-burning technique were the main means used to light homes, employed in candelabras, wall sconces, and elegant chandeliers.⏎It wasn
-
the year for both novice and veteran gardeners as green shoots emerge from bare earth, announcing the promise of beautiful blooms to come. But have you ever found yourself crouched beside a flower bed, puzzling over which plants exactly are pushing their
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: why do electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric electric
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
delay their evolution.⏎Cataract - Like fogged-up lenses⏎Cataracts make our vision blurry. This happens because, as you get older,
-
8 or more hours⏎Severe stomach or belly pain⏎Vomited three or more times in 1 day⏎Signs of dehydration include:⏎- Crying without tears⏎- Dry mouth⏎- Increased thirst⏎- Eyes that appear
-
meanings⏎Blind/Visual Impairment. Blind refers to a total loss of vision. Visual impairment indicates partial vision, also referred to as partial sight.⏎Cerebral Palsy. A group of conditions resulting from damage to the central nervous
-
disc implant. Efforts to find a solution to these challenges have been ongoing for more than 40 years.⏎Several artificial disc replacements for both the neck (cervical) and back (lumbar) spine are currently being offered to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:619 excites
- L22:1155 suppresses
- L24:1117 suppresses
- L21:493 excites
- L10:1282 excites
- L22:2723 excites
- L12:2943 weakly suppresses
- L24:2019 weakly excites
- L20:417 weakly excites
- L19:2419 weakly suppresses
- L3:1599 weakly suppresses
- L4:108 weakly suppresses "or" offering a choice in web text
- L22:607 weakly suppresses
- L20:216 weakly suppresses
- L20:314 weakly suppresses
- L20:2643 weakly suppresses
- L4:1172 weakly excites
- L18:2143 weakly excites
- L20:2375 weakly excites
- L22:1550 weakly excites
- L20:1254 weakly suppresses
- L24:105 weakly suppresses
- L9:224 weakly excites
- L20:1438 weakly excites
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 项目经理
- 产品经理
- em
- бав
- metab
- emme
- 实战
- SetActive
- enz
- emulate
Suppresses
- (server
- ılan
- ream
- nặng
- electric
- lí
- (records
- 杠
- án
- Electric