'and' after action verbs like click or stand
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'and' when it comes right after an action word, as in 'click and begin' or 'stood and proclaimed'. Turning it up made the model's writing wander into vague talk about community and helping others, but the link is loose.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
024.⏎The primary purpose behind implementing this law is to ensure that the people of certain industries who got affected because of COVID-19 can come back and work again. This only applies to the employees that were earlier laid off. The
-
uan, a Chinese cadre appointed as leader of the Chinese Communist Party in Tibet in March 1992, has called on "inland Chinese to come and help open up Tibet."⏎In 1994 preparatory work began on
-
the translation. So if you encounter any problem in our translation service please feel free to correct it at the spot. All you have to do is to click here and submit your correction.⏎Frequently Asked Questions (FAQ)⏎What do you mean by
-
handle unlike denominators or how to regroup or to borrow with mixed numbers? Take a deep breath and let us take it one step at a time. Click and begin.⏎GCF and LCM by Prime Factorization⏎A straight forward way
-
mentality:⏎– lack of self development;⏎As long as we believe that anything we need would be provided for by someone other than ourselves, we wouldn’t stand up and do something; we would not acquire skills we could use to add value to others
-
the failure of countless U.N. resolutions. Their votes were cast after they reviewed the same intelligence data viewed by the president. Their votes were cast after many stood and proclaimed that Iraqi dictator Saddam Hussein must not be allowed to remain in power.⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the 2017, the 2018, and the number of topics in the 2018, the number of topics in the "2018". The number of "2018"
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
In some areas the prevalence of hepatitis C is extremely high, as in Egypt, Saudi Arabia, the Phillipines and Papua New Guinea. The prevalence of hepatitis C antibody in volunteer blood donors is generally estimated at between 0.4% and
-
direct clitoral stimulation.⏎Some lesbian and bisexual women object to the term "sc<|endoftext|>Archaeologists have unearthed a hoard of Late Pictish and Roman silver buried in a field in Aberdeenshire.⏎The new finds include
-
was born as Ernesto Guevara de la Serna in 1928 to a middle-class family (Castaneda 1998, 3). He was Argentinean by birth but was later awarded with an honorary
-
when a load completes a circuit between the two terminals. This load is your device.⏎Why Aren’t All Batteries Rechargeable?⏎Disposable batteries are all alkaline batteries, which means the cathode is made of manganese oxide and the anode
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:2641 excites unclear: scattered word fragments
- L6:1679 excites 'and' joining two actions in instructions
- L4:57 suppresses
- L6:244 suppresses
- L6:2747 weakly suppresses
- L6:2000 weakly suppresses
- L5:1365 weakly suppresses
- L2:1669 weakly suppresses
- L4:2270 weakly excites
- L6:1642 weakly suppresses
- L3:262 weakly suppresses
- L4:478 weakly suppresses
- L6:2407 weakly suppresses
- L7:992 weakly excites
- L6:1880 weakly excites "by" introducing a deadline or means
- L6:2359 weakly excites
- L5:1359 weakly suppresses
- L6:439 weakly suppresses
- L1:1188 weakly excites
- L7:138 weakly excites 'to' after verbs like prove or time
- L7:57 weakly excites
- L3:1177 weakly excites
- L1:2825 weakly excites
- L5:431 weakly excites
Feeds later layers
- L14:1639 excites "and" joining two nouns
- L16:376 excites 'or' joining alternatives
- L12:2704 excites
- L18:2393 weakly excites
- L13:1336 weakly suppresses
- L14:659 weakly excites
- L23:2169 weakly excites
- L15:1176 weakly excites
- L17:2911 weakly excites
- L12:434 weakly excites
- L16:1644 weakly suppresses
- L16:940 weakly excites
- L12:2279 weakly excites
- L27:412 weakly suppresses
- L10:838 weakly suppresses comma in a list of paired nouns
- L24:2377 weakly suppresses
- L18:162 weakly excites
- L17:989 weakly excites
- L19:2040 weakly excites
- L17:2521 weakly suppresses
- L11:1569 weakly excites
- L23:1338 weakly suppresses
- L19:617 weakly excites
- L13:887 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Beaut
- eva
- jom
- oulos
- redi
- olf
- ônica
- nop
- geb
- laş
Suppresses
- UCE
- 在日本
- Toe
- นโยบาย
- пуст
- �
- inent
- 在网络
- itian
- suspected