'there' before are or is
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'there' when it starts a sentence like 'there are many' or 'there is evidence', especially after words like 'However' or 'Currently'. Turning it up made the model repeat forms of 'is' and 'were' over and over, which fits its role around these verbs.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
liver problems, he may start suffering from a metabolic disorder, liver disease, or type 2 diabetes. However, there are multiple drinks and foods that are good for liver repair and maintenance.⏎Read this
-
four basic categories. These include wood, dog, deer, and spinose ear ticks. However, there are many specific tick species within each of these categories. Some ticks are found across
-
time. Additionally, smart work can lead to innovation and creativity, as individuals are encouraged to think outside the box and find new solutions to old problems.⏎However, there are also disadvantages to smart work. First, it can lead to a lack of
-
feet, as well as issues with their reproductive systems. The virus does not affect humans and it belongs to the Picornaviridae family. Currently, there are seven known strains, of which only A and C have been verified in the
-
and a sense of purpose. Additionally, hard work can often lead to greater mastery of skills, as repetition and practice can lead to improvement over time.⏎However, there are also several disadvantages to hard work. First, it can be time-consuming,
-
. It is even accepted that the face of the Sphinx bears the likeness of Khafre (Chephren), the Pharaoh during that time.⏎However, there was no written record from that era regarding the Sphinx or its construction. In addition
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the process of the process of the process of the process of the process... so that you can make a decision as your own decision, its the process of the process of the process of the process... that you as your own decision, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of the most frustrating behaviors a dog owner can experience. It not only disturbs your sleep but also gives you the sense that the dog is not comfortable. So what are the reasons why dogs growl?⏎Here’s The Sort Answer To Why Your
-
of ink and carbon paper. A significant step forward towards the modern-day typewriter was achieved by the Italian lawyer Giuseppe Ravizza, whose “cembalo scrivano” (scribe harpsichord) had keys resembling
-
Without worrying about the problems, he started removing water from the sea with his beak.⏎Seeing this, another bird sitting beside him said, “What are you doing, you’ll not get any benefit from this.”⏎The crow replied
-
of gems, known only to kings.” Pliny described six varieties, among which the Indian, having six pointed angles, and also resembling two pyramids (turbines, whip-tops) placed base to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1729 strongly excites
- L17:1618 excites
- L21:2536 excites
- L18:427 excites
- L21:1362 excites
- L17:3071 excites
- L19:2942 excites
- L20:2622 suppresses
- L20:2222 suppresses
- L15:1007 suppresses
- L20:2508 weakly suppresses
- L16:2500 weakly suppresses
- L19:572 weakly excites
- L21:618 weakly suppresses
- L20:2360 weakly excites
- L21:1622 weakly excites
- L20:2994 weakly excites
- L19:482 weakly suppresses
- L20:2335 weakly excites comma ending an 'if' clause
- L21:2808 weakly excites
- L5:1094 weakly suppresses
- L17:2162 weakly suppresses
- L18:1050 weakly suppresses
- L17:1480 weakly excites
Feeds later layers
- L26:109 suppresses
- L24:2880 excites
- L24:299 excites
- L27:650 excites
- L27:500 excites
- L24:319 excites
- L27:804 excites
- L25:9 suppresses
- L23:1013 excites
- L24:565 excites
- L23:220 excites
- L25:822 excites
- L26:2947 excites
- L26:1097 excites
- L25:1502 weakly excites
- L26:440 weakly excites
- L26:1182 weakly excites
- L25:698 weakly excites
- L25:613 weakly excites
- L23:1572 weakly excites
- L23:1264 weakly suppresses
- L24:3019 weakly suppresses
- L24:1811 weakly excites
- L24:1423 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- are
- is
- ARE
- are
- were
- _are
- Are
- 的是
- Are
- .are
Suppresses
- YYY
- ahoo
- _Abstract
- ^.
- 好吗
- ackle
- 治好
- enment
- 平均水平
- ixo