'in' in 'this, in turn' phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "in" in set phrases like "This, in turn," or "which in some cases," where a sentence links a cause to its effect. Turning it up made the model's writing wander into unrelated topics like maths problems and multiple-choice questions, so the steering shows no clear link to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
phenomenon has been a great source of joy for many entrepreneurs and enthusiasts. We’re one step away from actually connecting everyday objects to the Internet, and that in itself is a true revolution.⏎There’s something undeniably exciting about this possibility
-
more relevant and useful to compliment eHealth.⏎Translation of healthcare documents is necessary in order help all people to correctly understand the message that is being conveyed. That, in turn, will help them make informed medical choices.⏎Translation for
-
such as:⏎Diagnosing and treating sleep apnea can help control these conditions. Not treating sleep apnea can aggravate the symptoms of those other conditions—which in some cases can be
-
thrive when the weather is warm and dry. Whiteflies feed on the gardenia’s sap and secrete a sticky substance known as honeydew. This, in turn, attracts sooty mold, which grows wherever the honeydew is
-
3). This negative relationship is observed when formal leaders experience a heightened subjective sense of power. As a consequence, they will tend to dominate group discussions. This, in turn, will lead other team members to perceive that their perspectives are not valued.⏎
-
in which these are growing, it helps the undisturbed roots to develop more profusely and enables it to tap more nutrients from the soil. This, in turn, facilitates a larger number of tillers (shoots) per root-system
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it is given in the book (or document) it is given in the document it is given in the document it is given in the document it is given in the document it is given in the document it is given in the document it is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to End all Wars, against the Greek King Antiochus Epiphanes who decided to wipe the Jewish nation from the face of the earth in about 160-165 BCE. A priest named Mattathias son
-
CE, his brother Domitian became emperor. Titus married twice, but his first wife died, and he divorced the second soon after the birth (c. 65) of his only child, a daughter, Flavia Julia, to
-
6 BC, Tyre regained its independence (from the Seleucids) and was allowed to keep much of its independence when the area became a Roman province in 64 BC.<|endoftext|>Complete Green Streets⏎Streets in Madison move people
-
title of husband and wife. Cleopatra and Ptolemy were members of the Macedonian dynasty that governed Egypt since the death of Alexander the Great in 323 B.C. Although Cleopatra had no Egyptian blood, she
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:363 excites
- L8:407 excites
- L20:1044 excites
- L16:1023 excites
- L19:1280 weakly excites end-of-document token between unrelated texts
- L7:1161 weakly suppresses
- L9:1947 weakly excites
- L7:969 weakly excites
- L2:2100 weakly suppresses
- L4:2361 weakly excites
- L1:2280 weakly excites
- L7:2311 weakly excites
- L18:2157 weakly excites
- L20:508 weakly excites
- L16:573 weakly suppresses
- L7:1752 weakly suppresses
- L18:828 weakly suppresses
- L18:1106 weakly suppresses
- L6:6 weakly excites
- L20:1120 weakly excites
- L4:289 weakly excites
- L1:2111 weakly excites
- L4:1599 weakly excites
- L13:594 weakly suppresses
Feeds later layers
- L25:2056 weakly suppresses
- L23:224 weakly suppresses
- L23:2736 weakly excites
- L22:2419 weakly excites
- L22:1702 weakly excites
- L25:306 weakly suppresses
- L24:853 weakly suppresses
- L25:832 weakly suppresses zero before a decimal point
- L22:2409 weakly suppresses
- L27:1502 weakly suppresses
- L24:146 weakly suppresses
- L23:1018 weakly suppresses
- L22:2086 weakly suppresses
- L22:661 weakly excites
- L25:3008 weakly suppresses
- L25:1669 weakly excites
- L27:1872 weakly excites
- L24:491 weakly excites
- L23:1222 weakly suppresses
- L22:2532 weakly excites
- L23:107 weakly suppresses
- L24:1234 weakly excites
- L23:2484 weakly excites number in days or time spans
- L24:1087 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- änger
- arding
- witter
- arkan
- iscrim
- лем
- adium
- śmy
- później
- }-{
Suppresses
- document
- document
- (document
- Array
- Array
- .document
- Document
- дер
- $('.
- документ