'once' after was/were/have
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the word 'once' when it comes after a verb like 'was', 'were' or 'have' and means 'at some time in the past'. Turning it up made the model write more about past events and history.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
an Emperor/ress before the Shoguns took complete power. Samurai probably existed well before the appearance of Shoguns.⏎It is also known that there was once an ancient civilisation in the area pre<|endoftext|>- Herbert A. Simon was an
-
, I get excited about this.)<|endoftext|>It is supremely closed-minded to throw away Homer and Mozart and Augustine.⏎Professor, music historian and composer Robert Greenberg once received a letter from a musician urging him to give up the traditional and classical repertoire
-
the labor movement and I highly doubt many children even know why they are out of school. Many have no idea children were once forced into backbreaking jobs in mines, textiles, glass factories, canneries
-
instructions to his eldest son, Louis X⏎If God send thee adversity, receive it in patience and give<|endoftext|>In a remote part of the Olympic Peninsula there was once a tiny seaport community
-
thagoras travelled east beyond Egypt and came back with the notion (but they say this of Jesus too).] A later report claims he told followers that he has once been Aethalides,
-
“Bookends” couldn’t describe the decade of freedom and love better. What a time it was! Paul Kantner of “Jefferson Airplane” was once quoted as saying “If you can remember anything about the 60’s,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I think the first thing I need to do is to start the process of thinking and I need to be more careful about the symptoms, and the effects of the disease. The problem is that I need to be more careful about the symptoms,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
having the encrypted string is pointless. However, this does NOT provide any meaningful security against a determined attacker as it is rather trivial to open up the executable in a debugger and simply look at the decrypted information as the program runs. This is only meant
-
for validating expression of miRNAs in whole genome analyses such as microarray studies7. The samples used in this protocol were from patients who underwent radical prostatectomy for clinically localized prostate cancer; however other tissues and cell lines can be substituted in
-
million people and produced economic losses of more than $1 trillion. But the agency pointed out that efforts to better deal with disasters have begun to bear fruit: even as the number of disasters increased 4-fold, the number of fatalities decreased by nearly
-
panther’s last remaining core habitat area. It would facilitate development that would bring 300,000 additional residents into this rural region.⏎Even as the federal agency acknowledges the significance of this proposal,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:1756 weakly suppresses
- L4:87 weakly excites
- L4:2846 weakly suppresses
- L2:84 weakly excites
- L3:2854 weakly excites
- L3:2103 weakly suppresses
- L3:1898 weakly excites
- L4:2570 weakly suppresses
- L1:2190 weakly excites
- L4:2725 weakly excites
- L3:2123 weakly excites
- L2:359 weakly suppresses
- L0:829 weakly excites
- L2:1176 weakly suppresses
- L3:2399 weakly excites
- L3:2100 weakly suppresses
- L1:2476 weakly excites
- L0:2888 weakly suppresses
- L2:680 weakly suppresses 'a' before a noun phrase
- L3:2345 weakly excites
- L4:1392 weakly suppresses
- L1:3052 weakly suppresses
- L4:1722 weakly suppresses unclear: word fragments inside names
- L0:2007 weakly suppresses 'key' after 'The'
Feeds later layers
- L8:1330 excites
- L7:2080 excites
- L6:1765 weakly suppresses
- L11:2653 weakly suppresses
- L14:1255 weakly excites
- L6:1492 weakly excites
- L11:2573 weakly excites
- L10:702 weakly excites
- L7:36 weakly suppresses
- L8:2859 weakly suppresses
- L23:1775 weakly suppresses
- L23:1777 weakly suppresses
- L25:626 weakly suppresses
- L12:2860 weakly suppresses
- L13:1760 weakly excites
- L15:2645 weakly suppresses
- L19:1271 weakly excites
- L7:2632 weakly excites
- L10:1357 weakly suppresses
- L13:2118 weakly suppresses
- L25:2915 weakly excites
- L8:2224 weakly excites
- L12:2419 weakly excites
- L9:2340 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- agne
- atrás
- venting
- 不适合
- ��
- adders
- vably
- vin
- imension
- Suppress
Suppresses
- @\
- ties
- 用途
- textarea
- meantime
- zb
- סי
- feof
- Site
- trak