connecting word after a full clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words like 'but', 'though', 'even if', 'because' or a comma that join one full statement to another, especially a contrast or a cause. Turning it up gave text that drifted on topic, but the link is not clear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, or drilling the item into the property.⏎For example, when a homeowner buys a bathtub at a store, it starts off as personal property. However, the bathtub becomes real property after it
-
your toes. This will prevent strain on your knee joints.⏎Burn Calories, but at a Slower Rate⏎You will burn calories using a rowing machine, but not as many as when running. According to the American Council on Exercise, a
-
have been mixed. Some clothing companies have paid compensation funds to victims, even though they didn’t employ anyone at Rana Plaza at the time of the accident,
-
cache turned on, Drupal stores all the HTML code for any page visited by an anonymous user directly into the database. When another request for the same page comes along, Drupal knows to fetch this page out of the database rather than re-generating it
-
had a C-section were less likely to do pelvic floor exercises, probably because they didn’t push the baby out with the pelvic floor. But pregnancy itself that
-
, in conjunction with the state Department of Natural Resources, to see how far it's spread.⏎The city could then decide to apply pesticides or cut trees down, but cutting would only be done when the beetle is dormant to prevent further spreading, E
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: its its its / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / /
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the risk of developing Alzheimer’s every five years after age 65.⏎Q. What lifestyle changes or other tips do you have to help prevent Alzheimer’s or delay its onset?⏎A. Research has found many lifestyle
-
structure in the world – a linear particle accelerator first dubbed Project M and affectionately known as "the Monster" to the scientists who conjured it – to explore the mysterious subatomic realm. Fifty years later, more than
-
into an all-engulfing process, why it is so difficult to stop once it has begun, and what our best hopes are for ending war or at least limiting its dangers.⏎Several important developments have taken place since Dr. Dyer published the
-
used for ropes is called a sheave. A single sheave mounted in a block and fixed in place simply changes the direction of force exerted on the rope passing over it. If the end of the rope that ordinarily would attach to the load
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:2475 strongly excites
- L16:2832 suppresses
- L16:1178 excites
- L18:358 excites
- L18:2698 excites
- L17:192 suppresses
- L18:2522 suppresses
- L18:636 suppresses
- L16:2515 excites
- L16:577 excites
- L17:444 suppresses
- L17:1867 suppresses
- L18:1220 excites
- L18:1504 excites
- L17:1536 excites
- L18:2470 excites
- L15:1226 suppresses
- L18:2753 excites
- L15:1047 suppresses
- L17:491 suppresses
- L15:2100 suppresses
- L15:2893 excites
- L17:1292 excites
- L15:3069 excites
Feeds later layers
- L23:1001 strongly suppresses
- L27:1047 strongly suppresses
- L20:2602 strongly suppresses
- L22:1029 strongly suppresses
- L27:953 strongly suppresses
- L20:1229 strongly suppresses
- L25:1279 strongly suppresses
- L24:2392 suppresses
- L23:334 suppresses
- L21:1091 suppresses
- L24:1127 excites
- L24:82 excites
- L26:763 suppresses
- L23:1203 suppresses
- L21:796 suppresses
- L26:908 suppresses
- L27:1495 suppresses
- L27:2345 suppresses
- L27:1646 suppresses
- L21:1276 excites
- L21:2413 suppresses
- L25:692 weakly suppresses
- L23:974 weakly excites
- L24:477 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- -Al
- ---------------⏎
- evin
- حياء
- )][
- -G
- .ordinal
- -Un
- ----------------------------------------------------------------------⏎
- --------------⏎
Suppresses
- its
- Its
- 其
- 它的
- Its
- 对其
- 为其
- 对其进行
- 使其
- 其所