'h' fragments and 'error' words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on a few word pieces, mainly a lone 'H' or '-h' inside words like long-haul and hurricane, and on the word 'error'. The negative side fires on 'H' at the start of gene and protein names. When turned up, the writing drifted toward words like 'exception', though the effect was loose.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Goodreads helps you keep track of books you want to read. Want to Read saving…. Want to Read Currently Reading Read. Other editions. Enlarge cover. Error rating book.⏎Browse more videos⏎Human Anatomy and Physiology are two most-related subjects
-
think, why ye are just the sen!⏎– Singin’ blow, ye winds, in the mornin’,⏎– Blow, ye winds, high-ho!⏎– See all clear yer runnun’ gear,⏎– An’
-
advantage because it would provide a strong base of resources and manpower that could<|endoftext|>LISE SCHIFFER, LCSW⏎Your Cart is Empty⏎There was an error with PayPalClick here to try again⏎Thank you for
-
the benefits of no contrails.⏎However, global air traffic is growing by around 3.5% each year, and many of these new flights are long-haul, high-altitude trips, which are the kind that form the most contr
-
had experienced severe disease requiring intensive care treatment.⏎In this way, Gao and his colleagues demonstrated that the tool could reveal signs of pulmonary fibrosis in COVID long-haulers, thus helping to account for shortness of breath, coughing and
-
a typhoon if it happened in the northwestern Pacific.⏎WHAT’S THE DIFFERENCE BETWEEN A HURRICANE AND A TROPICAL STORM?⏎Wind speed. When tropical
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: not all of the physical contents of a notepartepel would go into physical contents that would not come into physical contents yet, not all of the physical contents of a notepartepel would go into physical contents that would not
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
genes have been identified that increase the risk of prostate cancer, including RNASEL, BRCA 1, and BRCA 2, DNA mismatch genes, HPC1, and HoxB13
-
cells of mesenchymal origin. Upon HGF stimulation, MET induces several biological responses that collectively give rise to a program known
-
cause devastating side effects to children, and it's not clear how beneficial the treatments are for this disease.⏎Researchers are also exploring a potential new therapy that could target H3K27me3 and reverse the lowered levels. This work is still
-
by testing them for anti-HIV activity. In test tube experiments called “assays,” new compounds are added
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:1086 excites
- L22:1061 suppresses
- L19:2916 suppresses
- L20:1514 weakly suppresses
- L1:19 weakly suppresses
- L23:1073 weakly suppresses
- L22:693 weakly suppresses
- L24:105 weakly suppresses
- L20:359 weakly excites
- L22:1950 weakly excites
- L9:1932 weakly excites
- L9:2375 weakly suppresses
- L1:87 weakly suppresses
- L21:2904 weakly excites
- L18:344 weakly suppresses
- L21:3013 weakly suppresses
- L16:1235 weakly suppresses
- L18:173 weakly excites
- L11:1325 weakly suppresses
- L2:298 weakly suppresses
- L21:421 weakly excites
- L0:2569 weakly suppresses
- L9:1267 weakly excites
- L0:1686 weakly suppresses
Feeds later layers
- L27:1901 weakly excites
- L26:1473 weakly excites
- L27:202 weakly excites
- L26:2604 weakly suppresses
- L27:1438 weakly suppresses
- L27:714 weakly suppresses
- L26:250 weakly excites
- L26:1700 weakly excites
- L26:1782 weakly suppresses
- L27:1153 weakly excites
- L26:2646 weakly suppresses
- L26:1285 weakly excites
- L27:466 weakly suppresses
- L27:1505 weakly excites
- L27:1591 weakly suppresses
- L26:2119 weakly suppresses
- L27:1040 weakly suppresses
- L26:2901 weakly suppresses
- L27:1355 weakly suppresses
- L27:1631 weakly excites
- L27:2834 weakly excites
- L27:1859 weakly excites
- L27:923 weakly suppresses
- L26:1452 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- thrown
- catching
- exception
- Catch
- .exception
- thrown
- edException
- �行
- ERN
- ainers
Suppresses
- mor
- cimal
- ycin
- ide
- 垩
- 关节
- itably
- 价值
- мор
- ises