words right before 'have' or 'has'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on small words like 'not', 'also', 'always', 'may' and 'might' that sit right before a verb such as 'have' or 'has'. It is positive when a sentence is about to say what something has or can do. Steering results were only loosely related, with some 'have' and 'has' repetition.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
.⏎Rh (+) positive blood means that your red blood cells have D antigens on their surface. Rh (-) negative blood means that your red blood cells do not have D antigens on their surface.⏎Rh (+) blood is much more common
-
power solar panels. Sunpower panels are made up of photovoltaic cells that convert sunlight into electrical energy. While Sunpower solar panels have many advantages, they also have a few disadvantages.⏎Sunpower solar panels are a premium product and as such
-
. For in-depth answers, consider the following resources.⏎Stop By the Tutoring Center⏎Most high schools will not have a tutoring center, but colleges will almost always have an on-site tutoring center. At a university, the tutoring center is offered
-
), there is usually more personal information included in the newspaper than in official documents.⏎Almost every city has a newspaper, and many have more than one. Large cities may have multiple daily papers, while rural areas might have a weekly paper covering
-
, brake control function, motor phase number and working mode selection function, protection function (such as current limit, under voltage, overheating protection, etc.), some also integrated drive circuit.⏎Suitable for a certain speed but not high speed accuracy requirements
-
to conduct electricity on the other side. A single layer PCB is useful for simpler electronic devices and is a cheaper option.⏎- Double Layer PCB – A double layer PCB has a copper layer on both sides of the board. This type of PCB has
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's the first real product I have ever been the first product to there of there there there there, so there there there there, there there there there, there there there there, there there there there, there there there there, there
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
avoid this problem, follow the “10% rule”: increase mileage no more than a 10% per week. Keep in mind, though, that everyone is different and that even 10% may be too much of a weekly
-
are an academic or someone in academic publishing, have you ever wondered how many academic journals are there in the world? Well, I do.⏎It is estimated that there are currently more than 30,000 academic journals, and the
-
counterparts. It's common to experience extreme sadness, anger, guilt and anxiety about future pregnancies. There is no "typical" timeframe for emotional recovery; every woman experiences the grieving process in her own way and travels the road to healing at her
-
increase their happiness, it also increases our own. Studies amongst different cultures and ages have consistently found that individuals who spend money on others report higher levels of happiness than those who spend money on themselves. Researchers suggest that the reward we experience from helping others
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1503 strongly excites
- L20:1404 excites
- L19:2798 excites
- L20:1727 excites
- L19:504 suppresses
- L20:1932 excites
- L20:2696 suppresses
- L20:1596 suppresses
- L17:2314 suppresses
- L18:2846 suppresses
- L5:2275 suppresses
- L20:578 excites
- L3:520 suppresses
- L20:262 weakly excites
- L16:2010 weakly suppresses
- L17:2820 weakly excites
- L17:2763 weakly excites
- L18:991 weakly suppresses
- L20:2389 weakly suppresses
- L18:2119 weakly suppresses
- L18:1822 weakly suppresses
- L20:554 weakly suppresses
- L1:2538 weakly suppresses
- L12:2121 weakly excites
Feeds later layers
- L23:1235 excites
- L25:1994 suppresses
- L24:792 excites
- L22:238 excites
- L23:984 weakly suppresses
- L25:613 weakly suppresses
- L25:210 weakly excites
- L22:1349 weakly suppresses
- L24:670 weakly excites
- L25:929 weakly excites
- L27:756 weakly excites
- L22:1381 weakly suppresses
- L23:1500 weakly suppresses
- L23:2263 weakly suppresses
- L24:319 weakly suppresses
- L22:1671 weakly suppresses
- L23:628 weakly suppresses
- L24:1342 weakly suppresses
- L24:1263 weakly excites
- L24:1580 weakly suppresses
- L27:409 weakly excites
- L23:815 weakly excites
- L23:1090 weakly suppresses
- L24:2253 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- had
- has
- 具有
- have
- Owned
- having
- имеет
- .has
- 拥有
- يط
Suppresses
- ⼦
- 鼷
- ⽬
- there
- 间的
- There
- there
- cps
- THERE
- 岁的