word before a quantity or number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the spot just before a number or amount is expected, such as 'about [100] trillion', 'grows up to [900] mm' or 'close to [4]'. When it was turned up, the model's writing did not show a clear theme, so the effect on text is hard to pin down.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Significant Changes to Your Gut Bacteria⏎Science is increasingly revealing that microorganisms living in your gut are there performing indispensable functions. Known as your microbiome, about 100 trillion of these cells populate your body, particularly your intestines and
-
is found on mountain slopes throughout most of the Cape Floristic Region.⏎Erica plukenetii is an erect, sturdy shrub that grows up to 900 mm, but some forms may reach a height of up to
-
Dairy foods are a rich source of leucine, an amino acid known to stimulate muscle protein synthesis.⏎- Distribution of protein: Many experts now recommend getting about
-
the number one cause of cancer recurrence and treatment failure.⏎Dead cancer cells have been found to activate a pathway in the body mediated as a protein dubbed toll-like receptor 9⏎, or TLR9, that is present in the immune system and
-
weight and health.â⏎One of the secrets behind losing weight on a plant-based diet is to fill up with fiber. The Physicians Committee recommends consuming close to 4
-
strictor and helpful snake.⏎Black Rat Fun Facts:⏎- They are also known as Eastern Rat Snakes.⏎- These large constrictors can grow up to 7 feet long.⏎- They call suburbs, woodlands and farms home.⏎-
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the idea that a protein can be the target for a certain kind of enzymoliprotic protein, which is in the functional and structural role of the cell. This is an idea that is probably more central in the protein functional function.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the cell more concrete for students is to create edible cells. Using materials such as Jell-O® (to represent cytoplasm) and sprinkles (to represent ribosomes) will not only help your students understand the parts of the cell,
-
.html<|endoftext|>Glacier Park's cold winters, short growing seasons and high altitudes are less than ideal for reptiles. These animals are ectothermic, meaning they gather body heat from their surroundings. There are only three species of reptiles in
-
scientists' understanding of ATP's role in taste. "It's certainly an important piece of the puzzle," neuroscientist
-
plant cell plasmolyzed?⏎What is a hypertonic solution?⏎A hypertonic solution is a solution that has a higher concentration of solutes than found inside the cell⏎What are some of the functions of cell membranes?⏎Separation of cell
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:468 suppresses
- L10:378 suppresses
- L9:228 suppresses
- L3:37 suppresses
- L8:39 suppresses
- L18:1604 suppresses
- L3:1259 suppresses
- L6:2441 suppresses
- L5:319 suppresses
- L17:958 suppresses
- L7:20 suppresses
- L17:1142 excites
- L6:2918 suppresses
- L8:2952 excites
- L11:527 excites
- L16:842 suppresses
- L6:2640 suppresses
- L18:408 suppresses
- L3:1586 excites genes, genomes and exons
- L8:2354 suppresses
- L11:1867 suppresses
- L9:1662 excites
- L4:2742 suppresses
- L9:2752 excites
Feeds later layers
- L24:1306 strongly suppresses
- L27:728 strongly suppresses
- L22:814 suppresses
- L26:845 suppresses
- L21:2487 suppresses
- L22:1556 suppresses
- L25:2391 suppresses
- L25:1448 suppresses
- L26:1270 suppresses
- L22:586 suppresses
- L21:386 suppresses
- L24:2318 suppresses
- L23:487 suppresses
- L22:1014 suppresses
- L23:1887 suppresses
- L24:88 excites
- L24:2236 suppresses
- L25:545 suppresses
- L23:1484 suppresses
- L23:76 excites
- L22:2612 suppresses
- L22:1474 suppresses
- L24:1320 suppresses
- L23:2916 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- mozilla
- 掸
- 炉
- vacuum
- 真空
- 国家安全
- Vacuum
- 天然气
- Hòa
- bounce
Suppresses
- protein
- 蛋白
- 生物学
- physiology
- membr
- protein
- 酶
- biology
- Protein
- 生物