middles of split scientific compound words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the middle piece of long scientific or medical words that the model splits into several pieces, such as 'ricular' in 'atrioventricular'. It is weak overall. Turning it up gave off-topic text, so its job is hard to see in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
a characteristic rate of approximately 300 beats/min and a regular ventricular rate of about 150 beats/min in patients not taking atrioventricular (AV) nodal blockers. It can lead to symptoms of palpitations,
-
See our Data Citations and Acknowledgements policy for more information.⏎Large Scale Biosphere-Atmosphere : The Large-Scale Biosphere-Atmosphere Experiment in Amazonia (LBA) is an intensive scientific investigation of the tropical
-
on animal and human health at current levels of exposure.”⏎The study, “Triclosan impairs excitation–contraction coupling and Ca2+ dynamics in stri
-
with bile acids and intestinal barrier enhancers are all promising candidates.⏎Focus on the gut-brain axis: Multiple sclerosis, the intestinal barrier and the<|endoftext|>The future role of computers
-
actions. Normally, electrical stimulation (“excitation”) of isolated muscle fibers under experimental conditions evokes a muscle contraction, a phenomenon known as “excitation-contraction coupling” (E
-
that descend the<|endoftext|>Genital/ perigenital infection caused by the yeast-like fungus Candida albicans or occasionally by other species of Candida. Vulvovaginitis due to Candida presents with an erythema of the vaginal
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: and the I think I have I think I have I think I have I have I think I have I have I have I have I have I have I have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
period of time), and progressive (symptoms grow worse over time).⏎Although the disease may appear in younger patients (even teenagers), it usually affects people in late middle age. It is not contagious, nor is it likely passed on from generation
-
thought to be the world's oldest desert. The sun has been beating down on it for at least 55 million years and it covers an area of around around
-
year 2022, 95% of all workloads will be completed in the cloud.⏎Cloud computing initiates a grand shift from the old traditional IT management systems to new and improved digitally-powered administration. Some benefits of cloud computing
-
for example, may be harvested at several sizes or stages of development, depending upon market needs. Fruit that are too developed are of interior internal quality and show undesirable color change after harvest. This also applies to other immature fruit
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:827 strongly suppresses
- L5:2628 excites
- L5:2047 excites
- L2:645 excites
- L5:227 suppresses
- L5:1797 suppresses
- L5:51 suppresses
- L6:775 suppresses
- L5:1642 suppresses
- L2:1114 suppresses
- L1:767 suppresses
- L5:219 suppresses
- L5:223 excites
- L6:65 excites
- L1:654 suppresses
- L1:2020 excites
- L2:888 suppresses
- L4:103 excites comma after 'still' or 'in addition'
- L3:15 suppresses
- L0:972 excites
- L3:1150 excites
- L2:950 excites
- L2:1590 suppresses
- L5:585 suppresses
Feeds later layers
- L15:2713 suppresses
- L11:807 suppresses
- L10:2871 suppresses
- L8:1462 suppresses
- L8:967 suppresses
- L16:2450 suppresses
- L16:2599 suppresses
- L13:1814 suppresses
- L14:3070 suppresses
- L15:670 suppresses
- L9:1656 suppresses
- L8:602 suppresses
- L11:228 suppresses
- L17:1701 suppresses
- L15:2828 suppresses
- L17:80 excites
- L12:1700 suppresses
- L11:1077 suppresses
- L15:1495 suppresses
- L10:338 suppresses
- L8:1242 suppresses
- L15:1388 suppresses
- L8:109 suppresses
- L16:2452 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ospel
- elcome
- anticipated
- ��
- allen
- bargain
- argon
- idelity
- .GetResponse
- &p
Suppresses
- rei
- ера
- roi
- quier
- 化
- zers
- zi
- ifs
- usters
- ROID