unclear: word before a clause continues
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a word that sits just before the rest of a sentence finishes, such as "not [because]", "depends on [where]" or "acts committed [with]". The pattern is hard to pin down, and turning it up did not produce any clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Kennedy at Rice University in Houston in September of 1962:⏎“We choose to go to the Moon in this decade and do the other things, not because they are easy, but because they are hard, because
-
help reverse or prevent a brain herniation, the medical team will treat increased swelling and pressure in the brain. Treatment may involve:⏎The outlook varies and depends on where in the brain the herniation occurrs. Without treatment, death is likely.⏎
-
kin’s campaign was crowned with success in December 1948, when the United Nations adopted the Genocide Convention. It defined genocide as “acts committed with intent to destroy,<|endoftext|>1905 - 1938⏎
-
site, now owned by Agfa-Gevaert, the Belgian photographic film giant, is closed to the public. It is undergoing a state-ordered cleanup for soil and groundwater contamination linked to Peerless Photo Products, a previous owner that was acquired
-
it was held, the names of the people who attended and were absent (apologies), the main issues discussed should then be listed and what actions needs to take place. These can be printed off in paper for meetings and can be distributed electronically
-
school for children imprisoned with their mothers, and a<|endoftext|>Eating dark chocolate may ease depressive symptoms and have a positive effect on mood, according to a new study led by University College London (UCL).⏎The study, published in the journal Depression
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I've been thinking about... (a) I have been thinking about... (a) [a] [until] [until] [until] (a) [until] [until] (a) [until] [until
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to run continuously.⏎Reduce indoor air pollution sources such as smoking, burning incense, and frying foods.⏎If travelling in a car with air conditioning, keep the windows up and the ventilation set to recirculate.⏎If you are very sensitive to
-
electronic controls are required.⏎Figure 1: Structure of motors.⏎Types of stepping motors⏎There are several basic types of stepping motors:⏎- Variable reluctance motors with metal teeth.⏎- Permanent magnet motors.⏎- Hybrid motors with both permanent magnets and metal
-
directions. While returning from one of his campaigns, he was killed by one of his sons, who seized the throne. Bactrian coins were made to the Greek Standard, and this is one of the most beautiful coins of the late Hellen
-
to have ever lived. He was the Golden Warrior of the Bronze Age. Even Alexander the Great admired and emulated Achilles throughout his life, sleeping with a copy of the Iliad under his pillow. And yes, for me, Achilles was
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:456 excites
- L8:1916 suppresses
- L9:783 excites
- L8:2545 suppresses
- L7:1708 suppresses
- L9:306 excites
- L11:1669 excites
- L11:1349 suppresses
- L7:716 excites
- L11:1352 suppresses
- L7:1616 excites
- L11:1030 suppresses
- L9:1135 excites
- L10:1851 suppresses
- L9:1409 suppresses
- L11:2586 excites
- L11:599 excites
- L6:2369 excites
- L6:1360 suppresses
- L9:1726 weakly suppresses
- L8:1749 weakly excites
- L11:834 weakly excites
- L11:2065 weakly excites
- L10:278 weakly excites
Feeds later layers
- L13:1824 strongly excites
- L15:1731 strongly excites
- L18:2260 excites
- L13:2615 excites
- L13:2213 suppresses
- L13:848 suppresses
- L14:1514 excites
- L13:2866 excites
- L18:1319 excites
- L13:640 suppresses
- L16:2979 excites
- L18:1837 excites
- L13:3017 suppresses
- L13:623 excites
- L13:1122 suppresses
- L16:2573 excites
- L13:2113 suppresses
- L17:1432 excites
- L13:1028 suppresses
- L16:1277 excites
- L13:1581 excites
- L13:1562 excites unclear: words that set up a qualifier
- L15:402 suppresses
- L13:506 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 隨時
- 随时
- 时时
- 每月
- 每当
- 每周
- 每次
- 每个月
- 关键时刻
- 问我
Suppresses
- asty
- older
- urate
- _old
- old
- .named
- lymp
- ridged
- igious
- elder