'and' or 'the' joining two parallel items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is active on the small joining words, such as 'and' or 'or', that link two matching things in a pair or list, like 'scientist and mom' or 'humans, animals and the environment'. Turning it up made the model produce repetitive, circular sentences, which does not clearly show what the neuron does.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of contrasting brilliant color and shade. Some galleries insist that artists stand alongside their works during shows, juxtaposing the art and the artist.⏎Quiz: What is juxtaposition?⏎- The act of placing two things
-
an epidemic in much of the world. This year’s theme, “Unite to End TB”, highlights the need for a concerted effort by the TB research community and groups of patients and their families to effectively solve the problems that allow TB to still
-
of society to address today’s increasingly complex environmental problems. And there has been frustration on both sides: researchers want to see the result of their efforts being used, and decision makers need relevant information to assist in planning and practice.⏎To help close that
-
Raimi⏎In this podcast, RFF’s Daniel Raimi gives a balanced and accessible view of oil and gas development, drawing on both scholarly literature and his t...<|endoftext|>|Full name||Noam Chomsky
-
first woman allowed to observe at Caltech’s Palomar Observatory. Rubin also was a mother to four children–proving that she could be both a scientist and mom.⏎Strange to think of a time when women literally weren’t allowed to study
-
of individuals with intellectual disabilities may be rooted in the terms used to describe the condition, others have maintained that stigma may be inherent in the condition itself, not in the label used. This study took advantage of a recent change in terminology introduced in Israel
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the function of the function in the function's function, and what is the function's function's function? What is the function's function's function's function? The function is the function's function's function's function's function.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the industrial cotton make use of heavy pesticides, insecticides, herbicides and other dangerous chemicals that are harmful to humans, animals and the environment. Organic fabrics, unlike industrial cotton does not release any toxic fumes
-
to live out the American Dream. I came with a dream that one day I would be judged not by my birth, social status, or ideological affiliation but by my abilities and virtues.⏎What I most wanted from my new country was an equal chance
-
For the past few months, most people have isolated themselves indoors, and the impacts are striking. The lack of connections with each other, with our communities, and with the outdoors is negatively impacting our health, our wellness, our sense of calm—and
-
Biquard, translated by Geoffrey Strachan (1966). Frédéric Joliot-Curie: the man and his theories. Eriksson. p. 129.<|endoftext|>IBM is becoming
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:183 strongly suppresses
- L17:739 strongly suppresses
- L17:522 strongly suppresses
- L17:102 strongly excites
- L17:339 strongly excites
- L17:493 strongly excites
- L17:212 strongly excites
- L17:182 strongly excites
- L17:373 strongly suppresses words after comparisons and contrasts
- L17:91 suppresses
- L17:194 excites
- L17:604 suppresses
- L17:396 suppresses
- L17:536 excites
- L17:242 suppresses
- L17:495 excites
- L17:306 excites
- L17:319 excites
- L17:608 suppresses
- L17:329 excites
- L17:653 suppresses
- L17:275 suppresses
- L17:422 suppresses
- L16:594 excites
Feeds later layers
- L20:227 suppresses
- L19:2289 weakly suppresses
- L26:2899 weakly suppresses
- L25:873 weakly excites
- L22:545 weakly suppresses
- L19:590 weakly suppresses
- L21:998 weakly suppresses
- L19:960 weakly suppresses
- L25:27 weakly suppresses
- L23:2866 weakly excites
- L22:2659 weakly suppresses
- L19:1641 weakly excites
- L23:1818 weakly excites
- L19:2827 weakly suppresses
- L19:2176 weakly suppresses
- L25:2237 weakly suppresses
- L20:2541 weakly excites
- L21:843 weakly suppresses
- L23:2639 weakly excites
- L26:888 weakly excites
- L26:1957 weakly suppresses
- L20:2535 weakly excites
- L20:1644 weakly suppresses
- L20:2986 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 人身
- TAIL
- 户籍
- ervations
- idental
- -labelledby
- astos
- roid
- rist
- 户口
Suppresses
- enary
- ikon
- nhạc
- wick
- _cache
- postpone
- 华尔
- utes
- лад
- shall