"is" in "there is" sentences
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "is" in phrases like "There is no evidence" or "There is a strong tradition." It goes quiet, or dips, when the sentence is a negation such as "cannot" or "not." Turning it up made the model's text drift, with no clear link to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
community⏎WOODFORD COUNTY, Ky. (WKYT) – Ten years after the last resident left a historic African American community in Woodford County, there is now a new birth and a new way to remember a rich history .⏎What happened
-
without an ulceration (broken skin). There is no evidence that Stage I melanoma has spread to the lymph tissues, lymph nodes
-
& Wildlife Service (FWS).⏎The FWS announced its decision on the plant Thursday. The species remains on the FWS’s "candidate list," although there is no prediction of when, or if, it will actually receive ESA protection.⏎It
-
. There is a remarkable amount of mosaic pavement that is preserved – more than anywhere in the entire
-
. There is a thick green mat of vegetation, but little diversity to recommend to wildlife or the
-
.⏎Demonstration: This method uses an equal-arm balance rather than a domestic spring balance.⏎Class practical: A simple method for comparing the density of liquids.⏎There is a strong tradition of beginning physics with careful measurements of volumes and masses and calculations of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: is of is Okay, I have is of is. So, is of is is of is. That's of is is of is. So, of is of is is of is. Then of is of is of is. So
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
by itself. Therefore, a number of the more popular study questions include (but are not limited to) whether there are connections between colors and learning, whether students learn faster
-
. The deaths of Black women like Breonna Taylor, Sandra Bland, Regis Korchinski-Paquet, and others at the hands of the police cannot be forgotten. We acknowledge the pain of Black communities at large, but also recognize
-
of the coast, in consequence of which he called the peaked island to the westward of the cape, Magnetical Island: this irregularity, however, was not noticed by me in my observations near the same spot; and the difference observed by
-
ies⏎When we think about food allergies, we're much more likely to picture peanuts, shellfish or even eggs. But mild apple allergies are not uncommon. Of note, experts believe that it's the birch pollen that's
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:227 suppresses
- L16:466 excites 'is' after a long subject phrase
- L4:16 excites
- L14:924 excites
- L19:576 suppresses
- L4:4 weakly suppresses
- L15:599 weakly excites
- L18:93 weakly suppresses
- L15:286 weakly excites
- L19:1997 weakly excites
- L14:149 weakly suppresses
- L18:1389 weakly suppresses
- L5:351 weakly excites
- L19:1727 weakly excites
- L15:681 weakly suppresses
- L17:137 weakly excites
- L14:453 weakly suppresses
- L1:1409 weakly excites
- L11:1099 weakly suppresses
- L15:629 weakly excites
- L11:31 weakly suppresses
- L16:1168 weakly excites 'to' after verbs of change
- L17:327 weakly suppresses
- L17:706 weakly excites
Feeds later layers
- L22:228 suppresses
- L23:127 excites
- L26:53 excites
- L21:2478 weakly suppresses
- L25:9 weakly excites
- L22:666 weakly suppresses
- L23:1013 weakly suppresses
- L24:100 weakly excites
- L22:353 weakly suppresses
- L24:2880 weakly suppresses
- L26:1257 weakly suppresses
- L22:1434 weakly suppresses
- L22:1138 weakly suppresses
- L22:2821 weakly suppresses
- L21:2981 weakly suppresses
- L27:604 weakly suppresses
- L23:128 weakly excites 'for' as in 'for example'
- L25:247 weakly excites
- L22:2769 weakly suppresses
- L24:845 weakly suppresses
- L27:382 weakly suppresses
- L24:2684 weakly suppresses
- L23:30 weakly excites
- L21:930 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- considered
- taşı
- dışı
- 她说
- 实例
- seen
- particularly
- several
- LinkId
- some
Suppresses
- ivity
- 性
- iale
- edImage
- 性和
- 起了
- ed
- edy
- ivities
- imony