comma before but also in not only constructions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires on the comma that comes after a clause such as "not only X", right before the "but also" part that completes the contrast. Turning it down made the model repeat "instead of" and "rather than", which are the words that usually set up this kind of contrast, while turning it up gave lists of "and the same" phrasing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
you must understand and apply some crucial National Electrical Code rules and regulation. Following these rules to the letter will not only assure you that your work will pass inspection, but that it will be a safe installation as well. Improperly installed recess
-
mode of literary expression, that of the Petrarchan ideal of beauty and virtue. Tarquin may then be understood, Washington stresses, not just as the villain, but as one who commits a transgressive but necessary purging of literary hegemony
-
quarter of the 19th century and the decades leading up to World War II. The era is characterized by dramatic transformations in not just technological and industrial developments, but also in social and cultural institutions, including the world of art in its various
-
unhealthy social norms and values are ignored. People come to construe healthy behavior in terms of dependency on a medical industry that constantly invents not only new cures, but new diseases for the cures it already possesses (Blech,
-
every year so there are already lots of instances where these characters have been created.⏎By drawing inspiration from those, you would not only be paying homage to their work, but also improving your hand by practicing, exploring, and creating new ways to convey
-
, fostering customer relationships, and meeting business goals instead of constantly verifying the integrity of their data.⏎When data is dirty, it not only affects the productivity of teams, but it can also potentially hurt relationships with customers or damage the reputation of the business
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: rather than rather than rather than rather than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than than
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
employable or that your career prospects are good enough to allow you to pursue a career path of your dreams.⏎Different industry sectors demand different employability skills – personal as well as technical. Most employer surveys do, however, note that personal skills have
-
the world. Moreover, the pattern of suicides in China is quite different than in other parts of the world – there are more completed suicides among females than males and rural rates are three-fold urban rates. The lack of reliable suicide data prior to
-
is the sequence of events in the conversion of the chemical energy derived from ATP hydrolysis to a mechanical stroke? How are these altered in a processive motor, where each of the catalytic heads is subject to mechanical forces from intramolecular
-
who are more experienced, adults as well as inexperienced citizens such as children, not only in the knowledge of values but
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:3061 strongly suppresses
- L15:2926 strongly excites
- L14:1830 excites
- L15:1922 excites
- L16:533 suppresses
- L15:1055 suppresses
- L14:2500 suppresses
- L14:2386 excites
- L15:454 excites
- L14:864 suppresses
- L13:2418 excites
- L14:2535 suppresses
- L15:2448 suppresses
- L12:2918 excites
- L16:1084 suppresses
- L13:20 suppresses
- L12:537 excites
- L14:779 suppresses 'than' in comparisons
- L15:2542 suppresses
- L15:791 excites
- L13:737 excites
- L15:2640 excites
- L12:1987 excites
- L15:2015 excites
Feeds later layers
- L22:1337 strongly suppresses
- L19:2514 strongly suppresses
- L19:2308 strongly suppresses
- L21:1090 suppresses
- L21:2310 suppresses
- L20:1309 suppresses
- L18:2844 suppresses
- L18:3059 suppresses
- L27:1088 suppresses
- L18:1553 suppresses
- L27:2851 suppresses
- L21:478 suppresses
- L18:2331 suppresses
- L27:568 suppresses
- L18:2007 suppresses
- L18:2761 suppresses
- L19:2976 suppresses
- L22:1248 suppresses
- L21:783 suppresses
- L21:1597 suppresses
- L21:1008 suppresses
- L23:1127 suppresses
- L23:1955 suppresses
- L20:1646 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ionales
- ioni
- ện
- 개인정보
- IÓN
- 丘
- _mobile
- commerce
- onden
- очные
Suppresses
- versus
- vs
- 而不是
- 而非
- rather
- instead
- rather
- instead
- ではなく
- 而是