'that' starting a clause after a belief
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron lights up on the word 'that' when it introduces a belief or claim, like 'a misconception is that' or 'people think that'. It goes quiet, or strongly negative, on phrases like 'in fact', which mark a correction. Turning it up did not produce any clear theme in the sample text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
than the general population to suffer kidney failure later in life, probably in part because they were so super-healthy to start.⏎'There is this perception out there that donors don't want to be followed up. That's not necessarily
-
news. Depression is highly treatable. Studies show that a combination of antidepressant medication and psychotherapy is the best prescription.⏎One very common misconception about depression is that it feels like mere sadness. Sadness is only a part of it. It
-
intent to mislead in order to gain financially or politically.⏎Fake News vs Satire⏎If a well known comedy programme featured a parody of a news presenter saying that Donald Trump’s hair was actually a miniaturised Siberian Yeti implanted by
-
salt-water marine locales. I often hear that fresh water boats don’t even need anodes, or that zinc anodes are fine because they last forever, or that boaters shouldn’t mix anode metals with different metals underwater. Wrong, wrong
-
to get professional help.⏎Fathers, too, are profoundly affected by the loss of a child. Unfortunately, a common misconception regarding miscarriage and stillbirth is that only the mother is affected. Women often feel more freedom to cry and express their
-
don't remember "not" well. If you try to sell people on the concept that "Barack Obama is a Christian," you might convince some of them that he's not a Muslim. But if you try to sell people on "Bar
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I don't have to look for the problem. The problem is that I'm looking for the solution. The solution is that there is no solution. There is also a solution when the problem is not the case. That is, there is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ANDAS can be challenging even for the most skilled clinicians. Far too often, children and adolescents are misdiagnosed as having a mental illness, when in fact, they have an autoimmune disease, triggered by an infection.⏎Cunningham Panel
-
include feeling bloated, uncomfortable, and sluggish. In most cases, constipation is temporary and not serious.⏎Many people think they are constipated when, in fact, their bowel movements are regular. For example, some people believe they are const
-
avoid the mistake, you need to understand well what kind of fertile soil. Many people have the thought that the color of fertile soil is brown or red. In fact, black fertile soil is suitable for plants with flowers, while the brown or red
-
reemergence of whooping cough. Many people erroneously believe tetanus can only be acquired from rusty nails. In actuality, tetanus is all around us and can contaminate any skin wound.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:811 suppresses
- L7:2109 weakly excites
- L6:431 weakly excites
- L8:2677 weakly suppresses
- L2:678 weakly excites
- L2:1004 weakly excites
- L8:184 weakly excites
- L7:384 weakly excites
- L1:1155 weakly excites
- L3:2023 weakly suppresses
- L8:13 weakly suppresses
- L5:358 weakly suppresses
- L7:2488 weakly excites
- L7:71 weakly suppresses
- L8:421 weakly suppresses
- L5:1116 weakly excites
- L6:2447 weakly suppresses
- L8:2336 weakly suppresses
- L3:1907 weakly excites
- L4:2891 weakly suppresses
- L1:1564 weakly suppresses
- L4:3038 weakly suppresses
- L7:1095 weakly excites
- L0:2779 weakly suppresses
Feeds later layers
- L12:2574 suppresses
- L18:2248 suppresses
- L15:2891 suppresses
- L13:1055 suppresses
- L13:2930 weakly suppresses
- L17:2752 weakly excites
- L11:1065 weakly suppresses
- L21:1481 weakly suppresses 'the' before a topic noun
- L18:2619 weakly excites
- L10:251 weakly suppresses
- L25:2109 weakly excites
- L12:3069 weakly excites
- L19:2330 weakly excites
- L11:922 weakly excites
- L15:242 weakly excites
- L12:1987 weakly suppresses
- L11:2224 weakly excites
- L12:2647 weakly suppresses
- L20:2182 weakly suppresses
- L14:1305 weakly excites
- L13:3048 weakly suppresses
- L25:2212 weakly excites
- L11:71 weakly suppresses
- L12:1918 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- anches
- FullYear
- .record
- Followers
- overn
- 紀
- .fill
- .oracle
- frau
- meno
Suppresses
- l
- ogn
- disturbing
- ises
- ovid
- ane
- <?,
- omet
- A
- entertaining