'is' or 'was' after a subject
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron tends to fire on the verb that links a subject to what it is or was, like 'the same is valid' or 'the contest deadline is'. It switches off on words that start a new clause, such as 'that' after 'teaches us'. Turning it up did not produce any clear theme in the model's replies.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Mobile App: Apple Store | Google Play⏎Dear visitor, the comments section is undergoing an overhaul and will return soon.<|endoftext|>|You might also like:||Lotto (English)||L
-
diseases is only anticipated to rise as the population ages. The same is valid internationally and increasingly in emerging nations.⏎These trends have sparked a wide range of
-
month chosen because of a widely believed tradition that the world was created in March, and November is the ninth month after March. The ninth month
-
through Friday. Physicians in private practice associated with a physicians group or hospital may complete hospital rotations once or twice per week to visit patients under their care. The same is true for physicians who double as surgeons. Those who are primarily surgeons, however,
-
and the benefits of advancing gender equality to women, men and people of all gender identities. When we make progress towards gender equality, #EveryoneBenefits!⏎This week is an opportunity for people from coast to coast
-
Presence of Christ⏎By Chuck Collins⏎Center for Reformation Anglicanism⏎Transubstantiation became the official doctrine of the Roman Catholic Church at the Fourth Lateran Council that began on November 11, 12
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it is possible to have a good success in being a good person to be being being being being being to be being being being being to be being being being to be being being being to be being being being being to being being being being to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
courage to get up and try again. When we accidentally put our shirt on backwards, people smile and praise our independence. At this age, the world teaches us that failure is merely part of the journey to success.⏎But when we get to school
-
”, explain what punishment or penalties can be imposed against those whom cruelly treat animals, and describe minimum care requirements for impounded and wild animals.⏎Under Texas law, the cruel treatment of animals is forbidden. There are a number of actions that are
-
called a trader. But nowadays everything has changed: dealers, distributors, sales agents, brokers, commission agents and other intermediaries have appeared, and it is not easy for businessmen, not to mention ordinary people, to understand their differences from each other
-
legislation governs cultural property issues?⏎The Dealing in Cultural Objects (Offences) Act 2003 is of primary importance. It makes it an offence to deal dishonestly in tainted cultural property from anywhere in the world. It is
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:3035 suppresses
- L10:603 suppresses
- L14:2668 excites
- L18:535 excites
- L13:1506 suppresses
- L15:1910 weakly excites
- L18:2650 weakly excites
- L9:823 weakly suppresses
- L17:393 weakly excites
- L14:2748 weakly excites
- L9:2921 weakly suppresses
- L15:1545 weakly excites
- L11:1894 weakly suppresses
- L17:1210 weakly suppresses
- L18:2653 weakly excites
- L12:508 weakly suppresses
- L11:980 weakly excites
- L13:1671 weakly suppresses
- L10:448 weakly suppresses
- L12:1577 weakly excites
- L9:639 weakly suppresses
- L10:158 weakly suppresses
- L13:2527 weakly suppresses
- L12:2688 weakly suppresses
Feeds later layers
- L20:2529 suppresses
- L20:1909 suppresses
- L20:1617 excites
- L20:2883 suppresses
- L23:2497 weakly suppresses
- L20:2349 weakly suppresses
- L20:2795 weakly suppresses
- L21:2911 weakly suppresses
- L22:1180 weakly suppresses
- L20:1327 weakly suppresses
- L20:2134 weakly suppresses
- L20:1452 weakly suppresses
- L27:1337 weakly suppresses
- L22:2337 weakly suppresses
- L26:1335 weakly suppresses first piece of split proper names
- L21:2118 weakly suppresses
- L20:1814 weakly suppresses
- L23:966 weakly suppresses
- L20:1776 weakly suppresses
- L21:1035 weakly excites
- L21:2956 weakly suppresses
- L20:2558 weakly suppresses
- L27:2541 weakly suppresses
- L20:1073 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 供大家
- Wo
- doi
- Wo
- băng
- AO
- JUnit
- �
- pop
- W
Suppresses
- eced
- succes
- successful
- successful
- успеш
- mits
- success
- qualifies
- 崃
- appearance