the word 'more' after 'a'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word "more" when it comes after "a" or "a form of" in phrases like "a more serious problem" or "a more perfect union". When it was turned up, the model kept repeating words like "perfect" and "numerous", and when turned down it repeated "more" and "than".
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
in Europe. The Commission notes that the main environmental threat from bio-waste is the production of methane, a greenhouse gas (GHG) 25 times more potent than carbon dioxide.⏎In the Communication, the Commission recommends realizing bio-waste
-
nose are fragile, so it is no wonder that they can easily bleed. However, sometimes nose bleeds can become frequent. This may be an indication of a more serious problem.⏎One of the most common causes of frequent nose bleeds is dry
-
a crack in the terrace. As long as water flows up this point of weakness in the terrace, the cone continues to grow, but if the water finds a more convenient underground channel or if the orifice of the spring is sealed over by trav
-
and white rice, cause a rapid increase in blood sugar levels. On the other side, foods with low GI, such as whole grains and sweet potato, are more slowly digested, causing a lower and gentler fluctuation of sugar levels in
-
set forth in the “preamble,” or opening clause, of the Constitution of the United States;⏎1. “To form a more perfect union;”⏎2. “To establish justice;”⏎3. “To
-
causes of bedwetting in elderly adults. At its least, adult bedwetting is embarrassing and inconvenient; at its worst, it can be indicative of a more serious urinary tract problem. To help your health care provider properly determine a reason and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: more than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
that you select: .⏎You can also select a web site from the following list:⏎Select the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.⏎Contact your local
-
, and was incorporated into the Kingdom of Siam in 1786. Patani was divided into the three provinces Patani, Yala, and Narathiwat in 1808. Thailand's influence over the region
-
÷ 4 = 3,125 lbs⏎According to this calculation, the vehicle mentioned above will require each wheel to have a safe working load greater than 3,125 lbs.⏎Other factors that can affect wheel performance
-
coastal cliffs and villages and towns.<|endoftext|>Have you taken nonsteroidal anti-inflammatory drugs (NSAIDs) like diclofenac, ibuprofen or naproxen? A study of soldiers showed that people taking high doses of NSAIDs
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:3065 excites
- L23:2405 excites
- L21:2777 excites
- L4:344 suppresses
- L18:2374 suppresses
- L20:212 weakly excites
- L17:2447 weakly suppresses
- L7:2825 weakly excites
- L16:588 weakly suppresses
- L22:935 weakly suppresses
- L1:2396 weakly excites
- L22:2527 weakly excites
- L14:1426 weakly suppresses
- L15:699 weakly excites
- L4:1873 weakly suppresses
- L13:1276 weakly suppresses
- L19:739 weakly excites
- L3:1316 weakly suppresses
- L8:1572 weakly suppresses
- L22:1711 weakly suppresses
- L4:656 weakly excites
- L22:1046 weakly excites
- L23:3034 weakly excites
- L5:1087 weakly suppresses
Feeds later layers
- L26:551 suppresses
- L27:948 suppresses
- L26:1908 suppresses
- L27:755 suppresses
- L25:1196 weakly suppresses
- L27:1896 weakly suppresses split names and comparative stems
- L27:1006 weakly suppresses
- L27:1734 weakly suppresses
- L25:1425 weakly suppresses
- L26:1597 weakly suppresses
- L25:2908 weakly excites
- L26:880 weakly suppresses
- L27:1451 weakly excites
- L27:545 weakly excites
- L25:1046 weakly suppresses
- L25:2986 weakly suppresses '1' in 21st or 11th, before 'st'
- L25:787 weakly excites
- L26:1007 weakly suppresses
- L25:1185 weakly suppresses
- L25:2371 weakly suppresses
- L26:1382 weakly suppresses
- L26:396 weakly suppresses
- L27:1964 weakly suppresses
- L25:3053 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- numerous
- Every
- ",&
- Every
- ropa
- )],
- adamente
- %=
- ้ม
- ้อง
Suppresses
- 更
- more
- 更有
- 更为
- more
- hơn
- 更加
- 更大的
- 更大
- più