plural '(s)' after a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the '(s)' that writers add after a noun to show it could be singular or plural, as in 'type(s)' or 'animal(s)'. Turning it up did not produce text that clearly reflects this idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and delayed the release? Provide reasons for your decision.⏎You must first post your answer(s) before you can see the other students’ posts. Submit your initial post(s
-
American Society for the Prevention of Cruelty to Animals (ASPCA), "Animals in Entertainment" refers to any animal(s) used to act, perform, fight and/or kill for the enjoyment of humans
-
case of a power outage or other emergency. Furthermore, employers may want to designate a person(s) responsible for obtaining and maintaining the SDSs. If the employer does not have
-
include generalized anxiety disorder, social anxiety disorder, and separation anxiety disorder. It is possible to have more than one, or possibly all three. No matter what type(s) of anxiety you are experiencing.⏎Examples of anxiety disorders include generalized anxiety disorder,
-
, you may have dry eye. A thorough ocular surface evaluation with our dry eye specialists will determine whether dry eye is present, and if so, what type(s) of dry eye are affecting
-
permanent magnet or an electromagnet.⏎A typical docking operation begins with the docking spacecraft maneuvering into position near the docking port on the parent vehicle. The electromagnet(s) are then turned on, and, if necessary, the docking spacecraft is then
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
wolves.⏎tAsAM ruditashabdena gavAM haMbhAraveNa cha |⏎vrajasyotthApanaM chakrurghoShavR^iddhAH
-
studies in more clinically relevant models. Proceedings of the National Academy of Sciences USA (PNAS) has published the study online this week.⏎Argentinian scientist Andrés Dekanty, a Juan de la Cierva researcher in the Mil
-
igulinœ and genus Clangula; a garrot. The common goldeneye is C. glaucion or C. clangula of Europe and Americn. Barrow's goldeneye is the Rocky Mountain garrot, C. bar
-
ordinary Muslims gathered in every street, whipped into a frenzy by slogans which rang out from the loudspeakers of mosques. One such slogan was,⏎‘Asi gachchi Pakistan, Batao roas te Batanev san
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:1291 suppresses
- L3:720 excites
- L5:1577 excites
- L2:1599 excites
- L6:949 excites
- L5:2843 excites
- L3:1016 excites
- L3:494 suppresses
- L4:1044 excites
- L2:1301 suppresses
- L2:2129 weakly suppresses
- L4:2807 weakly excites
- L3:284 weakly suppresses
- L3:1092 weakly suppresses
- L6:2181 weakly suppresses
- L3:817 weakly suppresses
- L2:1397 weakly excites
- L3:1955 weakly excites
- L4:1088 weakly suppresses
- L4:290 weakly excites
- L0:2566 weakly suppresses
- L3:27 weakly excites
- L4:1067 weakly excites
- L4:1300 weakly suppresses
Feeds later layers
- L9:897 suppresses
- L8:517 suppresses
- L10:799 suppresses
- L11:1722 suppresses
- L15:998 suppresses period inside an abbreviation
- L8:917 suppresses
- L15:1498 suppresses
- L9:39 weakly suppresses
- L14:143 weakly excites 'the' inside journal and institution names
- L11:2942 weakly suppresses
- L9:2354 weakly suppresses
- L11:1393 weakly suppresses
- L11:705 weakly excites
- L10:77 weakly suppresses
- L12:753 weakly excites
- L15:1382 weakly suppresses
- L9:2249 weakly suppresses
- L15:1554 weakly suppresses
- L13:1210 weakly suppresses
- L15:991 weakly suppresses
- L11:765 weakly suppresses
- L9:392 weakly suppresses "and" inside organisation names
- L17:1612 weakly suppresses
- L14:1617 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- raise
- etta
- 万人
- One
- Pix
- ra
- raise
- holder
- ruc
- 許
Suppresses
- aternity
- ides
- positor
- ackbar
- информацион
- sabot
- deactivated
- ilm
- 不清楚
- liberated