'from' after verbs and adjectives of separation or origin
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'from' after words like 'fall', 'fell', 'sick', 'tired' or 'wet', as in 'fell from 13.1 to 10.7'. Weak negative activity appears on 'of' after words like 'number' and 'percentage'. Turning it up didn't produce a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
when you are sick.⏎Currently there are no advisories restricting travel to the Arabian Peninsula or South Korea.<|endoftext|>"The most significant fact is that it will not fall from inside pressure. Only outside, foreign, hostile intervention can destroy it."⏎In fact
-
experienced a significantly smaller reduction in their poverty rates than those counties that did not add new Wal-Mart stores.⏎Overall, the portion of families living in poverty nationwide fell from 13.1 to 10.7 percent between 19
-
2% of their income on entertainment – plus they would have better access to water, sanitation and electricity. These, then, are the “winners” from globalisation: an expanding group for whom global growth has meant a serious rise in
-
ped into the room, ivory-handled pistol on his belt, jodhpurs flaring from his hips to knees. The general, tired and irritable from the long months of planning and training, and the longer months of fighting, was
-
to check the soil of the Medusa head before watering. If the soil is dry, it means that the plant requires irrigation. If the soil is still wet from the last watering, it is better to wait for the soil to completely dry to
-
time each day. This method appeals to many people because you can tailor the timing to your lifestyle and schedule, says Kelly. For example, some people may fast from 8pm until lunch around midday the next day, or they may eat
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: 10% chance of being in, and if you get any number of times that you have, you will have to stay, and if you get a lot, you should be ready to take action. (See the same for
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
loss surgery developed an alcohol-abuse problem compared to the 11 percent of those who underwent gastric banding.⏎“We knew there was an increase in the number of people experiencing problems with alcohol within the first two years of surgery, but we didn
-
Opinions and Lifestyle Survey.⏎The percentage of current smokers in Great Britain has remained at 19% compared with 2013, but the percentage of male smokers
-
adults older than 65 — they accounted for a smaller proportion of deaths in these populations.⏎Among the eldest two age groups, however, the percentage of deaths attributable to opioids remained
-
to cardiovascular-related disability and death is also clear. In fact, in a study from Helena, Mont., last year, researchers found an immediate reduction in the number of heart attacks – a 40 percent decline – when a clean indoor air policy
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:658 excites
- L0:2085 weakly suppresses
- L4:2310 weakly excites
- L2:1789 weakly suppresses
- L4:2166 weakly suppresses
- L4:1409 weakly suppresses
- L1:2924 weakly excites
- L3:2800 weakly suppresses
- L4:192 weakly excites
- L1:883 weakly excites
- L1:522 weakly excites
- L0:2426 weakly excites
- L4:827 weakly excites
- L4:2735 weakly excites
- L2:2322 weakly excites
- L2:2570 weakly excites
- L0:2423 weakly excites
- L4:879 weakly excites
- L1:2771 weakly suppresses
- L1:338 weakly suppresses
- L4:1394 weakly excites
- L2:2718 weakly excites
- L3:808 weakly excites
- L0:330 weakly excites
Feeds later layers
- L6:853 weakly excites
- L19:1868 weakly suppresses
- L6:2143 weakly excites
- L20:1643 weakly excites
- L22:457 weakly excites
- L15:1019 weakly suppresses
- L10:1784 weakly excites
- L19:1666 weakly suppresses
- L18:2751 weakly suppresses
- L17:975 weakly excites
- L9:1806 weakly suppresses
- L18:2300 weakly excites
- L17:1776 weakly excites
- L11:1384 weakly excites
- L17:1792 weakly excites
- L7:1798 weakly excites
- L26:2580 weakly suppresses
- L25:515 weakly suppresses
- L20:1440 weakly excites
- L7:1882 weakly excites
- L14:2462 weakly excites
- L13:2249 weakly suppresses
- L10:1496 weakly excites
- L24:2159 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- quil
- -League
- HOLDER
- booklet
- olith
- 设计
- orna
- 的设计
- etas
- ubo
Suppresses
- lichkeit
- 望
- keit
- APPED
- minLength
- Intermediate
- mj
- aris
- 吻
- commodo