passive 'formed by' and 'based on' phrasing
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is weak and fires on the small word right after a noun that starts a 'made by' or 'based on' phrase, like 'formed by', 'generated', or 'came from'. Turning it up did not produce a clear theme in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
additional requirements that will protect bees. EPA will consider the other uses at a later date as data become available to support those uses. EPA made this decision after careful consideration of public comments and supporting science.⏎E
-
pouring of similarly signed romantic notes in subsequent centuries.⏎Nineteenth Century<|endoftext|>Icelandic Sheep Breeders of North America⏎The following rules were formed by the late Dr. Halldor Palsson who was the leading sheep specialist in
-
Earth but still might contain life.<|endoftext|>New guidelines have been launched for educators, using of electronic communication like social media.⏎The guidelines were created by a working group formed by the
-
activity is designed to have students analyze energy use, cost, and source patterns from household to regional scales and relate these patterns to CO2 emissions. This idea was generated at ...⏎Learn more about this review process.⏎Mentos and soda eruptions
-
new area of dark patches that covers some 34,000 square kilometres.⏎The new dark patches are most likely lakes of hydrocarbons, created by rain that poured from summer clouds, says Turtle. "It's the first time
-
civil war with the Nationalists under Chiang Kai-shek, in which millions died.⏎Chiang and the remains of his government fled to Taiwan that December after a last stand in
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the point of being a good and useful person in the future? So, considering the future, what can be done or not done in a professional, personal, or societal context to maintain or maintain a good standing? So, in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
various shades of colours. These LEDs have four legs. … To control colours on an RGB LED we would use pulse width modulation, or PWM for short.⏎Do LEDs use PWM?⏎LEDs rely on PWM for maintaining their voltage.⏎
-
months. In fact, feeling blue during the late fall and throughout the winter is so common that it has a name: seasonal affective disorder. SAD for short, this condition is often called the Winter Blues. But if you think these feelings
-
well-known way to initiate meanings out-of acronyms, which happen to be abbreviations noticable due to the fact words: RAID, and that is short for redundant selection of separate (otherwise cheaper) discs, identifies a pc shops program that
-
the primary problem lies with the heart muscle cells themselves; these diseases are called cardiomyopathies. Different cardiomyopathies are caused by different cellular defects, but most
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:152 suppresses
- L5:2925 excites
- L8:753 weakly suppresses
- L8:1195 weakly suppresses
- L6:733 weakly suppresses
- L6:1949 weakly excites
- L3:2806 weakly suppresses
- L7:2726 weakly suppresses
- L1:2388 weakly excites
- L6:1654 weakly excites
- L6:1254 weakly excites
- L6:1975 weakly excites
- L7:773 weakly suppresses
- L6:2089 weakly suppresses
- L6:897 weakly excites
- L5:83 weakly suppresses
- L7:1880 weakly suppresses
- L7:633 weakly suppresses
- L1:2141 weakly excites
- L2:1653 weakly excites
- L2:2416 weakly excites
- L8:1735 weakly suppresses the word 'National' in park names
- L7:1326 weakly suppresses
- L7:912 weakly excites
Feeds later layers
- L10:2232 weakly excites
- L13:236 weakly excites
- L12:1405 weakly excites
- L11:1367 weakly excites
- L15:1642 weakly excites
- L25:236 weakly excites
- L26:1024 weakly suppresses
- L11:896 weakly suppresses comma closing an introductory phrase
- L15:1519 weakly excites
- L10:396 weakly excites
- L17:24 weakly excites
- L11:992 weakly excites
- L17:2634 weakly suppresses
- L17:1761 weakly suppresses
- L11:1446 weakly excites
- L16:505 weakly excites
- L25:2054 weakly suppresses
- L21:2553 weakly excites
- L21:2755 weakly suppresses
- L17:2262 weakly suppresses
- L15:2757 weakly suppresses
- L11:741 weakly suppresses
- L12:29 weakly excites
- L10:1375 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- stadt
- ient
- 幕后
- pon
- arios
- stant
- 另有
- hd
- consulted
- due
Suppresses
- /problem
- tighter
- ck
- ложений
- cker
- ück
- ivicrm
- principalColumn
- (vertical
- isque