unclear: word pieces in medical terms
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It fires on word fragments inside long medical or scientific names, such as vitamin E and thyroid terms. When turned up, the model kept writing 'not' and "don't", which hints at a negation role.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
are moved or pressed away from their usual position inside the skull.⏎Herniation syndrome; Transtentorial herniation; Uncal herniation; Subfalcine herniation; Tonsillar herniation; Herniation - brain⏎
-
population sizes and genetic diversity at the time of DFTD emergence, owing to elevated devil abundances following the extinction of the previous apex predator - the thylacine - approximately 80. years ago.<|endoftext|>Drupal is a free and
-
index. According United States Agency for International Development Ethiopia is one of the poorest and most food-insecure countries in the world. And the African capital Addis Ababa is
-
take it more seriously. It goes without saying that being in the middle of a pandemic is stressful to everyone, however, people with chronic diseases such as hypo- or hyperthyroidism, Grave’s diseases, goiter, thyroid cancer,
-
:⏎- Vitamin E (α-tocopherol)⏎- Causes and Risks for Vitamin E Deficiency⏎- Symptoms of Vitamin E Deficiency⏎- Food Sources of Vitamin E⏎- Vitamin K⏎- Ris
-
1, the term Kabinett was officially noted in German wine law, and it was given its current definition which applies to wines which are light and non-chaptalized – chaptalization is the process of adding sugar to unfer
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to share a shared identity between people who are super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super super
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
team studied the copper chaperone protein Atx1, which provides a good model of copper metabolism in animal cells. "We wondered what the drug tetrathiomolybdate did to copper chaperones -- proteins charged with safely ferry
-
ding Light On The Workings Of An Anti-Cancer Drug⏎Crystal structure shows how drug disables harmful copper in cells⏎The copper sequestering drug tetrathiomolybdate (TM) has been shown in studies to be effective in
-
In 1993, the foundations to the Dhamma Talaka Peace Pagoda were laid in Birmingham, England. Supported by the Birmingham Buddhist Vihara, the pagoda underwent a large amount of planning. The circumference of the
-
experiment involved 42 severely depressed patients who had already agreed to undergo electroconvulsive therapy (ECT), which is typically used as a last resort when all other measures have failed.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:826 excites
- L23:391 suppresses
- L18:1369 excites
- L20:126 suppresses
- L17:2025 excites
- L19:2954 suppresses
- L15:2791 excites
- L16:295 excites
- L15:2058 suppresses
- L18:1286 excites
- L19:2114 suppresses
- L18:1381 excites
- L16:1560 excites
- L22:289 excites
- L15:407 suppresses
- L22:693 suppresses
- L20:1765 suppresses
- L15:2411 suppresses
- L19:1637 suppresses
- L19:2607 suppresses
- L19:3025 suppresses
- L22:1678 suppresses
- L16:2907 excites
- L18:3033 excites
Feeds later layers
- L26:406 strongly excites
- L27:714 strongly excites
- L27:2800 excites
- L27:860 excites
- L27:918 excites
- L27:873 excites
- L26:521 weakly excites
- L26:781 weakly excites
- L26:786 weakly excites
- L26:1098 weakly excites
- L27:2042 weakly excites
- L26:536 weakly suppresses
- L27:926 weakly excites
- L27:685 weakly suppresses
- L26:215 weakly excites
- L26:2103 weakly excites
- L26:1233 weakly excites
- L26:754 weakly suppresses
- L27:2409 weakly excites
- L27:219 weakly excites
- L26:1868 weakly excites
- L27:1290 weakly suppresses
- L27:1592 weakly excites
- L26:983 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 不
- not
- doesn
- don
- doesn
- 不
- not
- didn
- не
- 都不
Suppresses
- Gratuit
- tré
- meer
- rawn
- ʀ
- devil
- anova
- -pencil
- JV
- asename