'only' in 'not only ... but also'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the word 'only' in the phrase 'not only ... but also'. Its strongest negative reactions come on the word after a number and unit, such as 'years old' or 'grams of'. Turning it up gave text that drifted into repetitive or unrelated sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
at the same time or within days or weeks of getting the COVID vaccine,” he adds. What’s more, you can take the COVID-19 vaccine not only with your flu shot but also all vaccines for which you qualify to ensure that you
-
Boost Be Added⏎PK additives should be applied to healthy plants during the first week for flowering.⏎Other Uses For PK Booster⏎PK boosters can be used not only to help promote healthy flowering but can also be used if your plants have a PK
-
history, but we do know that it originated as a time of preparation for Easter. From the church’s earliest days, the resurrection of Christ was celebrated not only each week (on Sunday, the Lord’s Day), but also in a special
-
ANS Diagnostic Criteria⏎Treatment of PANS and PANDAS⏎Since PANS and PANDAS are autoimmune syndromes, it’s imperative to treat not only the underlying infection(s) but the immune dysfunction as well. Treatment can include antibiotics
-
They represent an Australian commitment to achieving the highest possible level of teacher quality so each young Australian can gain the best possible education. The standards recognise that it matters not only that every child achieves success, but also that they are successful in the kind of
-
other metabolic problems. This immunity takes place even if the animals are severely obese or have high amounts of cholesterol and consume dangerously fatty foods. Use of the compound not only appears to prevent the development of these diseases, but also to reverse the symptoms of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of the phone number (e.g. 1000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and 7 a.m.?⏎These practical challenges are all about making a 'tray' and covering it with paper.⏎My cousin was 24 years old on Friday April 5th in 1974. On what day
-
experts warn that excess sugar consumption can lead to several serious health complications and diseases. The American Heart Association reports that most Americans consume an average of 22 grams of added sugar per day, much higher than the recommended 6 teaspoons for women and
-
and education that may help them reach their goal:⏎- Amount of protein: Experts recommend adults over age 65 consume .45 to .68 grams of protein per pound of body weight daily (1.0-1.5 gm
-
of the debt in uncorrected dollars can be found at the website of the U.S. Treasury, where you can see that the U.S. debt was $75,463,476.52 in the year
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2658 strongly suppresses
- L14:1778 strongly suppresses
- L14:2939 excites
- L14:2201 excites
- L14:2984 suppresses
- L12:2691 suppresses
- L14:2590 suppresses
- L14:2253 suppresses
- L14:744 excites
- L14:1850 excites
- L13:549 suppresses
- L12:1043 suppresses
- L13:796 suppresses
- L14:1993 excites
- L12:2830 excites
- L13:1708 excites
- L14:1831 suppresses
- L13:2868 suppresses
- L2:2744 weakly excites
- L13:2971 weakly excites
- L12:2593 weakly excites
- L14:2483 weakly suppresses
- L13:1919 weakly suppresses
- L13:226 weakly excites
Feeds later layers
- L16:1569 strongly excites
- L16:2987 suppresses
- L16:2802 suppresses
- L17:2753 suppresses
- L18:2408 excites
- L16:1621 suppresses
- L20:1281 suppresses
- L19:245 suppresses
- L18:845 suppresses
- L17:1488 suppresses
- L19:1765 suppresses
- L19:2371 suppresses
- L17:975 suppresses
- L18:2132 excites
- L22:1279 excites
- L17:2105 suppresses
- L20:750 suppresses unclear: chinese academic text, 'when' loops
- L16:1831 excites
- L16:1292 suppresses
- L17:2964 excites
- L17:1476 excites
- L20:1569 suppresses
- L17:1394 suppresses
- L17:424 excites sentence-ending full stops
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- October
- living
- living
- |⏎
- October
- 经过多年
- before
- .herokuapp
- __⏎
- histó
Suppresses
- рем
- erais
- egret
- кал
- amburg
- cil
- 的身影
- anime
- ermo
- ENTA