unclear: 'as' after a verb phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It fires most on 'as' after verbs like 'emerges' or 'slashed', and it dips on 'the' in phrases like 'off the mark'. Turning it up gave off-topic text, so the steering does not explain it.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
HEXA-1,3,5-TRIENE). AROMATIC COMPOUNDS ARE ALWAYS FOLLOWS THE SUBSTITUTION REACTION BECAUSE OF THE STABILITY OF THE BENZENE RING. IT WILL
-
human colon cancer cell-lines has demonstrated that the “fat hormone” leptin may enhance the growth of colonic cancer cells. The discovery not only offers an explanation as to the underlying cause of the increase colon cancer risk in obesity but could lead to
-
of “students like you, who found concepts such as this difficult, tended to do better in tests when they used these learning materials”.⏎While the data generated as a byproduct of online courses provide a valuable resource in their own right<|endoftext|>The
-
in reverse order? According to the laws of physics, this can happen.⏎NARRATOR: It's a world that comes to light as we probe the most extreme realms of the cosmos, from black holes to the Big
-
students to report<|endoftext|>Farmers in designated Nitrate Vulnerable Zones (NVZs) are to have the amount of manure they can spread on fields slashed as Defra seeks to combat the problems caused by over-fertilisation.⏎The ‘
-
on the size confinement. By analyzing the growth temperature dependence, we unambiguously revealed that there is a coupling between the LLCCs and the inner tubes as strongly supported by a model of coupled Raman modes. This allows us to directly
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the world of a lot of people, the world of a lot of people, the world of a lot of people, the world of a lot of people, the world of a lot of people, the world of a lot of people,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
page of the newspaper on this day in 1933. Hitler was made Chancellor on January 30th. So, what was he up to the day after the Reichstag fire, as published on March 1st?⏎-
-
, 2001: A Space Odyssey, Stargate, and Avatar. As is often the case, sci-fi may not be that far off the mark, as NASA believes that stasis will be crucial to future missions to Mars
-
cadmium in children’s products– today the agency backed down. They are suggesting that the industry self-enforce. Hmmmm? How well did that work out the last time when we were talking about lead. We are especially concerned that children’s
-
Types of Sources for a Research Paper | Pen and the Pad There are two types of research<|endoftext|>The Apollo 11 space flight landed the first humans on Earth’s Moon on July 20 1969. The mission, carried
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:65 excites
- L5:227 suppresses
- L5:33 excites
- L5:1459 excites
- L5:2566 excites
- L5:38 suppresses
- L6:158 excites
- L1:1192 weakly excites
- L4:78 weakly suppresses line breaks inside a sentence
- L3:123 weakly excites
- L6:10 weakly excites
- L4:2901 weakly suppresses
- L5:3 weakly excites
- L4:84 weakly excites
- L6:161 weakly suppresses
- L2:501 weakly excites
- L5:955 weakly excites
- L4:632 weakly suppresses
- L5:2685 weakly excites
- L4:75 weakly suppresses
- L5:129 weakly excites
- L6:924 weakly suppresses
- L1:739 weakly excites
- L3:927 weakly suppresses
Feeds later layers
- L8:382 suppresses
- L8:967 suppresses
- L14:375 suppresses
- L11:2632 suppresses
- L15:2081 suppresses
- L10:1985 suppresses
- L16:1540 excites
- L8:1433 suppresses
- L15:1495 suppresses
- L8:781 suppresses
- L15:1653 suppresses
- L15:817 suppresses
- L15:540 weakly excites
- L15:2713 weakly suppresses
- L9:268 weakly suppresses
- L8:411 weakly suppresses
- L17:798 weakly suppresses
- L8:602 weakly suppresses
- L15:762 weakly suppresses
- L20:423 weakly excites
- L16:247 weakly suppresses
- L16:1475 weakly suppresses
- L8:326 weakly excites
- L15:482 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 如果是
- 若您
- pu
- を求め
- 若
- 若有
- 其中
- geometric
- isError
- 其中一个
Suppresses
- -level
- anding
- hood
- ansa
- 렉
- 级
- izr
- ional
- ળ
- -Level