medical term word starts
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the start of a medical or nutrition word, such as the 'hyper' in hyperglycemia or the 'cyst' in cysteine, just before the rest of the term arrives. Turning it up or down did not produce a clear change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
osis, nonketotic hypoglycemia, low or normal total carnitine⏎blood levels, dicarboxylic aciduria.⏎Mild hyperammonemia and slight elevation of liver transaminases may also⏎be present
-
the body uses and stores energy and how the body grows. The thyroid gland makes two forms of thyroid hormone, T4 (thyroxine) and T3 (triiodothyronine).⏎Many babies with congenital hypothyroidism appear
-
Ba along with lysine has a synergistic effect on growth rate and feed efficiency. That's because the ratio of sulfur-amino acids, methionine and cysteine, to lysine is important to maximising pig performance.⏎The entire
-
and fat-free milk, yogurt and cheese to help ensure all the essential amino acids the body need are eaten. Dairy foods are a rich source of leucine, an amino acid known to stimulate muscle protein synthesis.⏎- Distribution of protein: Many
-
(DASH) Eating Pattern May Reduce Age-Related Cognitive Decline⏎The Dietary Approaches to Stop Hypertension (DASH) diet is often recommended by physicians to people with high blood
-
of diabetes type 1 are also increasing day by day. Diabetes mellitus is a clinical syndrome that is characterized by hyperglycemia due to absolute or relative deficiency of insulin. In this article we
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The one thing I am always on the [redundant] [we can choose to do] [one of the [demonial] [demonial]][[demonial]][[demonial]][
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
or belly pain⏎Vomited three or more times in 1 day⏎Signs of dehydration include:⏎- Crying without tears⏎- Dry mouth⏎- Increased thirst⏎- Eyes that appear sunken⏎- Skin changes -- for example
-
immune systems that predispose them to develop infections.⏎Infection is a serious and frequent complication of nephrotic syndrome.⏎The clinical signs of neutropenia manifest as infections, most commonly of the
-
infection of the prostate.⏎As the cancer grows symptoms may include:⏎- Trouble urinating⏎- Decreased force in the stream of urine⏎- Blood in semen⏎- Discomfort
-
Kidney Failure?⏎- Swelling of the legs or face⏎- No GST⏎- Generalized swelling⏎- Changes in<|endoftext|>By Rebecca Morelle
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:1407 excites
- L22:1166 suppresses 'to' after words needing an infinitive
- L22:1797 excites
- L22:2342 excites
- L19:2939 excites
- L17:1934 suppresses
- L18:2300 excites
- L19:1499 weakly excites
- L21:892 weakly suppresses
- L12:235 weakly suppresses
- L22:2740 weakly suppresses
- L18:2643 weakly suppresses
- L21:3044 weakly excites
- L6:2829 weakly suppresses
- L22:893 weakly suppresses
- L20:1360 weakly suppresses
- L14:2346 weakly excites
- L12:2073 weakly excites
- L22:2766 weakly suppresses
- L17:956 weakly excites
- L20:2771 weakly excites
- L4:2188 weakly suppresses
- L2:459 weakly excites
- L5:91 weakly excites
Feeds later layers
- L27:564 weakly excites
- L25:1155 weakly excites
- L24:1072 weakly suppresses
- L26:980 weakly excites
- L25:1758 weakly excites
- L24:2266 weakly suppresses
- L27:2928 weakly suppresses
- L27:2955 weakly excites
- L27:1227 weakly excites
- L24:1068 weakly suppresses
- L27:807 weakly suppresses
- L26:430 weakly suppresses name fragments inside split words
- L27:1326 weakly suppresses
- L24:2791 weakly suppresses
- L24:76 weakly excites
- L24:2699 weakly suppresses
- L25:1277 weakly excites
- L26:882 weakly suppresses
- L24:1361 weakly suppresses
- L26:1068 weakly suppresses
- L26:829 weakly excites
- L25:1483 weakly suppresses
- L25:1233 weakly excites
- L25:755 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 人死亡
- serter
- eways
- ṁ
- 侦探
- .googleapis
- izontal
- hower
- timeofday
- يد
Suppresses
- ena
- 宽
- accel
- acceleration
- accel
- acceler
- eno
- 加速
- Acceler
- stitution