end of a document boundary
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron switches on at the invisible marker that ends one web page or document and starts an unrelated one. Its strongest moments are the places where one text stops and a different one begins. Turning it up made the model's writing drift into rambling, unrelated sentences rather than any clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
pipes also allow septic gases to escape.⏎Every plumbing fixture must have its own trap, a U-shaped space built into the fixture (in the case of toilets<|endoftext|>Medical-Surgical Nursing at a Glance⏎Medical-Surgical Nursing at a Gl
-
bands near 30 degrees north and south latitude.⏎Middle latitude semiarid and desert climates are in the rain shadows of mountain ranges. Winds that descend the<|endoftext|>Genital/ perigenital infection caused by the yeast-like fungus Candida alb
-
northern and eastern portions. In the south and west, landforms consist mostly of alluvial valleys, and coastal floodplains. Approximately 42 percent<|endoftext|>Putting early childhood education to gender equality’s use⏎Research shows that the concept of
-
object to the styptic pencil as much, or more, than toenail cutting. The black end of the stick is held to the bleeding nail and gently rotated<|endoftext|>'Shocking impact' of Winter Hill fires could lead to asthma and lung cancer
-
, which includes Knox County and parts of Eastern Ohio.⏎Contracting measles is especially serious for infants younger than one.<|endoftext|>In southern California, east of Los Angeles, where yellow tongues of smog lick
-
to go somewhere, and you don’t have a good hold on her, she’ll drag you along for the ride. She’s usually heading for the nearest fruit<|endoftext|>In a few days a carrier rocket
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the place where the old and the new, the old, the new, and the new again? . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
manifest, as it takes time for the build up of abnormal proteins to form between cells in the brain and ultimately cause death<|endoftext|>More About Andalusian Olive Oil⏎Olives and olive oil are arguably the most important food crop in Andalusia
-
prescription NSAIDs.”⏎Readers aware of this link are anxious to find alternatives to NSAIDs to ease pain.⏎Can You Ease Joint Pain with Natural Alternatives?⏎Q. I had a close relative who self-medicated his joint pain with naprox
-
Here are a few tips that you can follow that may come in handy as you ready your youngster for yet another academic year.⏎Steps to Help Your Chid Prepare⏎These tips can help you help your middle school-aged child prepare emotionally, mentally and
-
deep. Examine the root structure and if they extend only into the first 2 inches, your soil may be compacted.⏎Benefits of Aerating your Lawn⏎Better Drainage & Reduced Runoff⏎In addition to shallow roots, compact soil
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:259 excites
- L10:1244 excites
- L10:1340 excites
- L12:605 excites
- L9:25 excites
- L6:216 excites
- L8:807 excites
- L5:238 excites
- L10:84 suppresses
- L9:542 excites
- L1:1279 suppresses
- L9:2447 excites
- L4:183 excites
- L10:306 suppresses
- L10:494 suppresses
- L11:2444 suppresses
- L12:1950 weakly excites line break after a section heading
- L12:5 weakly excites
- L7:118 weakly excites sentence end before a line break
- L11:784 weakly suppresses
- L6:67 weakly excites
- L9:2669 weakly excites
- L9:2729 weakly suppresses
- L9:605 weakly excites
Feeds later layers
- L16:2189 suppresses
- L14:2061 excites
- L17:554 excites
- L20:460 weakly suppresses
- L27:236 weakly excites
- L16:1736 weakly suppresses
- L14:1833 weakly suppresses
- L22:545 weakly suppresses
- L18:705 weakly excites
- L21:1018 weakly excites
- L15:2009 weakly suppresses
- L20:1795 weakly suppresses
- L14:808 weakly suppresses
- L14:1098 weakly suppresses
- L17:1616 weakly excites
- L24:192 weakly suppresses
- L16:2996 weakly suppresses
- L17:1490 weakly excites
- L15:1565 weakly excites
- L17:856 weakly excites
- L16:190 weakly excites end-of-document boundary token
- L18:135 weakly suppresses
- L27:251 weakly excites
- L14:853 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- adal
- nämlich
- ileged
- oz
- 只知道
- regation
- agar
- 再说
- zwar
- awan
Suppresses
- ']",
- ")!=
- ']))⏎⏎
- '):⏎
- ervice
- '],⏎⏎
- '){⏎
- ')</
- ��
- ')"⏎