quantity word after large, high or low
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word that completes a size phrase, such as 'amounts' in 'large amounts' or 'levels' in 'high levels'. Its negative side is weak and not clearly about anything. Turning it up or down did not clearly change the model's writing in a visible way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
in the capitol city, and we are honored to be the newest member of EBR Schools.⏎IDEA believes all students can achieve at a very high-level regardless of income, geography, demographics, or special education needs. Public charter schools
-
bi-products such as saw dust and planer shavings. This production demanded large amounts of water, and thus the pump tower and a water line was established. Both
-
ons are usually produced by eating large amounts.⏎Common symptoms of jaundice include: A yellow tinge to the skin
-
, the high levels of vitamin K in broccoli can help to improve arterial function and reduce the risk of
-
low levels of H3K27me3 that could predict prognosis.⏎"We could do
-
the 1995 Galvin Report, weapons-related activities during the Cold War resulted in:⏎- About 77 million gallons of very dangerous high-level radioactive waste left over from the production of plutonium;⏎- Approximately 2.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of 20000000000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
this subject, there is absolutely no scientific evidence that eating shark, or taking supplements in any way, will provide any medicinal benefits whatsoever.⏎2. Swordfish photo credit: BigStock⏎This is another very large fish that eats other contaminated fish as
-
we will be doing. It's going to be another productive year in physical education class!<|endoftext|>Spring 2010 ACCESS #36⏎Just Road Pricing by Lisa Schweitzer and Brian D. Taylor⏎Economists have long advocated
-
meaning is determined" (Zuck, pp. 20). F. Biblical Theology "Biblical theology is the study of divine revelation as File Size: KB.⏎Get this from a library! Principles of biblical interpretation: (s
-
are an expectant mother, in which case, avoid these fish entirely. We will list some healthier options at the end of this list.⏎1. Shark photo credit: BigStock⏎This means any type of meat eating shark such as Longfin
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L6:442 excites
- L11:1433 excites
- L5:115 weakly suppresses
- L23:1203 weakly suppresses
- L1:654 weakly excites
- L16:1837 weakly suppresses
- L11:1368 weakly suppresses
- L14:1186 weakly excites
- L6:2176 weakly excites
- L17:1552 weakly excites
- L16:247 weakly suppresses
- L1:317 weakly suppresses
- L22:2178 weakly excites
- L1:2819 weakly excites
- L1:81 weakly suppresses
- L11:15 weakly suppresses decade and century numbers like 1950s
- L25:428 weakly suppresses
- L12:2719 weakly excites
- L16:2782 weakly suppresses
- L1:1933 weakly excites
- L4:1345 weakly excites
- L21:1909 weakly excites
- L2:1983 weakly excites
- L10:2775 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- spb
- plemented
- ernes
- zej
- iphers
- .VK
- LLU
- gements
- osa
- bery
Suppresses
- Krank
- 健康成长
- 心理健康
- >*</
- 患病
- ở
- back
- .tell
- 健康发展
- 痪