copula after 'probably' or 'may'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It tends to fire on the verb right after a hedge word like 'probably', 'may' or 'is', when the sentence is judging whether something is true or false, as in myths and warnings. Turning it up made the model repeat questions and phrases, so the effect is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
than 88cm (34 inches)⏎..... HDL cholesterol less<|endoftext|>Geese have the reputation of attacking innocent bystanders like walkers and golfers. Geese become aggressive because they don’t like to share their space with humans and
-
far out, get a cramp, suffer an injury, or get caught in a current.⏎Myth: Dry or secondary drowning is not a real thing.⏎Reality: While rare (and these terms are considered medically obsolete), breathing problems can
-
like the one on the right. Its open end can point up, down, left or right. A curve of this shape is called 'parabolic', meaning 'like a parabola'.⏎Quick navigation: Geometric Figure⏎: A u
-
before you fill out any forms, or give out money or credit card details.⏎- Don't accept any offers that seem too good to be true - they probably are.⏎Remember to always be
-
ata' signifies. It is truly said that whatever is in the world is in the Mahabharata, and what is not in Mahabharata is not in the world; thus stating a simple fact that answers to issues that we face
-
for you, don’t worry. Enjoy the ease of formatting equations in TeX, along with all the benefits of a What You See Is What You Get (WYSIWYG).⏎What if you could simply insert your equations into your document with
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I can't be sure that I can't be... I can't... I can... I can I... I... I... I... I... I I... I I... I I I... I I I... I I I I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
in the soil, beneficial soil bacteria ate the calcium citrate and excreted the calcium in a form that allowed it to react quickly with sodium phosphate to form calcium apatite, which covered the sand and soil particles underground, forming the sponge
-
Prevention. But thankfully, blood pressure can usually be lowered and managed through simply making better lifestyle choices.⏎And just as lowering your cholesterol naturally is better than using statins, lowering your blood pressure is best done without relying solely on medication. Let’s
-
myth, Tefnut became angry with her father Re and ran off to Nubia. The god Thoth went to find her and conjoled her into returning to Egypt.⏎
-
were excellent patients. They were pretty healthy, with a mean body mass index of 26 — just barely overweight — and only 3.6 percent of them smoked. They were also good sports: By the end of the trial, more
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:1593 suppresses
- L12:202 excites
- L14:124 suppresses
- L11:111 excites
- L13:627 suppresses
- L13:230 excites
- L12:1843 suppresses
- L8:10 suppresses
- L13:385 excites
- L14:101 suppresses
- L10:2410 suppresses
- L13:290 suppresses
- L11:1134 excites
- L11:1391 excites
- L10:1452 suppresses
- L11:1377 suppresses
- L13:255 weakly excites
- L13:489 weakly excites
- L12:583 weakly suppresses
- L14:494 weakly suppresses
- L14:65 weakly suppresses
- L13:310 weakly suppresses
- L10:490 weakly suppresses
- L6:13 weakly suppresses
Feeds later layers
- L16:1346 excites
- L16:329 suppresses
- L16:1090 suppresses
- L16:1149 suppresses
- L20:176 excites
- L16:1359 suppresses
- L16:2209 suppresses
- L16:631 excites
- L16:510 excites
- L18:1536 suppresses end of web page disclaimer
- L16:1861 suppresses
- L16:392 suppresses
- L16:2921 excites
- L19:839 suppresses
- L17:198 excites
- L16:1903 suppresses
- L18:997 excites
- L16:972 weakly suppresses
- L16:1743 weakly excites
- L18:497 weakly suppresses
- L18:199 weakly excites
- L19:821 weakly excites
- L16:966 weakly suppresses
- L18:157 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Invoker
- :async
- 렌
- 辞
- レン
- język
- oggles
- iska
- aprend
- ренд
Suppresses
- xAA
- orse
- xBA
- Pais
- Phoenix
- xbe
- Cooper
- PECT
- Napoleon
- xBB