line break after a section heading
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron wakes up on the line break that comes right after a short section title in a web article, such as a heading like 'Redundancy and Backup' just before the body text starts. Turning it up didn't produce anything clearly related, so its exact role is hard to pin down.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and more. These activities not only promote critical thinking and problem-solving skills but also foster a love for scientific inquiry.⏎Cultivate Creativity with Arts and Crafts⏎Artistic expression plays a vital role in a child’s development. Encourage your
-
it wavier and sluggish. This results in prolonged weather patterns, whether they be heatwaves or cold spells.⏎Case Study: Arctic Influence on North American Winters⏎In a recent issue of National Geographic, Arctic air is increasingly reaching southern
-
design digital circuits and systems at a higher level of abstraction, making FPGA design more efficient and less error-prone.⏎Differences Between Microcontrollers and FPGAs⏎Microcontrollers are programmable, which means that developers can write software to control the
-
entire foot, including your heels, and not just with your toes. This will prevent strain on your knee joints.⏎Burn Calories, but at a Slower Rate⏎You will burn calories using a rowing machine, but not as many as when
-
freely practice their faith without prejudice.⏎California law provides protections against discrimination based on an individual’s sexual orientation, including LGBTQ+ individuals.⏎Pregnancy and Family Status⏎Pregn<|endoftext|>Seeing Moses walk out of sight in the vaporous heights of Sinai
-
one child coercing another to follow suit. Often the behavior being pressured is questionable or taboo, such as smoking cigarettes or drinking alcohol.⏎Peer Pressure and the Brain⏎Recent studies find that peer pressure influences the way our brains behave, which leads to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: a year ago, or a month ago, or a day ago. So I have been thinking about 20 years ago. I have been thinking about 20 years ago, 20 days ago, or 20 days
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Advisory Awareness among a Representative Sample of Wisconsin Adults, 2017–2019" (2022
-
any other parasitican superfamily and, to a much greater extent<|endoftext|>Is dog saliva cleaner than humans?⏎Is My Dog’s Mouth Cleaner Than a Human Mouth? The general answer to this question is no, a dog’s mouth is not technically
-
. But the code base or project is not necessarily used for the production version of the application.⏎What is a mockup logo?⏎What Is A Logo Mockup? A logo mockup is a template you can use to present your logo designs in
-
atic encephalopathy), vomiting blood or passing out altered blood in the stools. Of course, there is the dreaded complication of liver cancer.⏎Generally, cirrhosis appears in at least 20% of patients within 20 years
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1706 excites
- L2:156 suppresses
- L2:189 suppresses
- L0:2919 weakly suppresses
- L1:1441 weakly suppresses
- L0:667 weakly suppresses
- L2:373 weakly excites
- L2:1413 weakly excites
- L0:788 weakly excites
- L2:34 weakly excites
- L2:2279 weakly excites
- L1:2385 weakly suppresses
- L1:300 weakly suppresses
- L1:168 weakly suppresses
- L2:411 weakly suppresses
- L1:175 weakly excites
- L1:1097 weakly suppresses
- L1:2676 weakly suppresses
- L2:1132 weakly suppresses
- L2:351 weakly suppresses
- L1:637 weakly suppresses
- L0:337 weakly suppresses
- L1:1666 weakly excites
- L1:2791 weakly suppresses
Feeds later layers
- L5:1078 excites
- L4:402 excites
- L9:257 excites
- L6:451 excites line break before a subheading
- L6:937 excites
- L5:2956 excites
- L8:1195 weakly excites
- L4:43 weakly excites
- L15:2829 weakly excites
- L4:260 weakly excites
- L8:666 weakly excites
- L19:1685 weakly excites
- L4:1149 weakly suppresses
- L21:524 weakly excites
- L5:530 weakly excites
- L14:784 weakly excites
- L6:1013 weakly excites
- L15:3048 weakly excites
- L16:2905 weakly excites
- L15:975 weakly excites
- L5:343 weakly excites
- L20:2342 weakly excites
- L17:2137 weakly suppresses
- L18:983 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ificial
- 这个时代
- 绰
- ighted
- lessness
- 这篇文章
- gerekt
- 这个词
- /bit
- [block
Suppresses
- .setEnabled
- izens
- 帮他
- ('.')
- }
- ElementsByTagName
- allowed
- .allowed
- ()
- res