the word 'a' after play or places
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'a' when it follows a verb like 'play' or 'places' and comes before a phrase like 'a crucial role' or 'a heavy burden'. Its strongest negative cases are 'a' after 'parts of' or 'elements of' in questions. Turning it up didn't change the text in a way that matched this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
human actions. But did you know that the production of meat and other animal products, in particular, places a heavy burden on the environment in a number of ways1?⏎1) Cut Your
-
, Number 2 publication, refers to the second issue of its 25th-year publication.⏎The role and importance of academic journals⏎Academic journals play a pioneering role in research and academia. They provide a platform for academic researchers to share
-
not to say that there’s no incentive to punish offending players. Some symbolic punishment is likely necessary as part of the process of restorative justice. There is also a body of research demonstrating the importance of punishment in the context of “just deserts
-
Pigment Granules⏎Have you ever wondered what makes up the structure of your hair? The intricate anatomy of our hair strands comprises several distinct components, each playing a unique role in the appearance and health of our hair. In this article, we
-
number of nodes as |V| (or the cardinality of V).⏎Paths and cycles will play a large role in our graph algorithms. A path is some sequence of edges that allows
-
and efficient lighting, and an explanation of important energy engineering terms and concepts. This new edition adds a new in- depth chapter on the battery. Batteries play a crucial role in our phones, computers, watches, light sources, kitchen appliances,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first step, and I would have the opportunity to the top floor of the House of the Mire. So if you could not have the opportunity to the top floor, then the first step is not the end. If you could not
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
valuable body and mechanical components behind it. It is designed to be a sacrificial part and must be replaced if damaged in a collision.⏎What are the parts of a bumper?⏎More videos on YouTube⏎- Bumper / Energy Absorber /
-
?⏎- What are the 3 elements of a folktale?⏎- What is the purpose of folk tales?⏎- What does
-
/ Romantic Tales.Tales of the Stupid Ogre.Jokes and Anecdotes, Formula Tales, Unclassified Tales.⏎What are the 3 elements of a folktale?⏎Story ElementsCharacters are flat.Usually very good or very bad
-
of recycled glass goes:⏎A. South for the winter⏎B. Back into new bottles and jars⏎C. Roadway sub-base⏎The primary ingredients of a glass container:⏎A. Ceramics, rocks, and metal caps⏎B.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1062 weakly suppresses
- L2:1960 weakly excites word endings in health and biology compounds
- L2:70 weakly excites
- L2:874 weakly excites
- L0:988 weakly excites
- L0:2657 weakly suppresses
- L1:325 weakly excites
- L1:23 weakly suppresses
- L1:2457 weakly excites
- L0:2688 weakly excites
- L1:1389 weakly suppresses
- L1:555 weakly suppresses
- L0:2831 weakly excites
- L1:2727 weakly suppresses
- L2:2242 weakly suppresses
- L2:1657 weakly excites
- L1:518 weakly excites
- L2:1443 weakly suppresses
- L1:1037 weakly suppresses
- L0:1649 weakly excites
- L0:428 weakly suppresses
- L1:2197 weakly suppresses
- L1:2875 weakly excites
- L0:1564 weakly suppresses
Feeds later layers
- L13:2976 weakly suppresses
- L5:991 weakly suppresses
- L8:112 weakly suppresses
- L17:2035 weakly suppresses
- L17:1862 weakly suppresses
- L15:610 weakly excites
- L10:1959 weakly excites
- L16:2809 weakly suppresses
- L18:2849 weakly suppresses
- L9:291 weakly excites
- L18:703 weakly suppresses
- L11:848 weakly excites
- L15:1951 weakly suppresses
- L4:505 weakly suppresses
- L18:2904 weakly suppresses
- L8:191 weakly excites
- L11:937 weakly excites
- L8:1368 weakly excites
- L24:2334 weakly suppresses
- L7:2840 weakly excites
- L11:1960 weakly excites
- L13:2639 weakly suppresses
- L16:1546 weakly excites unclear: repeated or split word pieces
- L11:2126 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- �能
- ++];⏎
- erca
- كن
- ]--;⏎
- embro
- �
- arti
- ypes
- cker
Suppresses
- igest
- liệt
- iversity
- ạm
- illustrator
- ylie
- hindsight
- Bris
- advertisers
- school