word pieces before 'trans' or 'transfer'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the start of words that are about to become 'trans', 'translation', 'transfer' or 'transfusion', such as 'TRAN' in 'TRANSLATED' or 'transf' in 'transfusion'. When it was turned up, the model kept producing the word 'transfer' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
.1 Laminated core⏎- 1.2 Toroidal⏎- 1.3 Autotransformer⏎- 1.4 Variable autotransformer⏎- 1.5 Induction regulator⏎- 1.
-
amps) and norovirus (often called "stomach flu" which also causes nausea, vomiting, stomach cramps, fever, and fatigue). Cross-contamination
-
ED TOPIC: HERE⏎E-GO EDITED BY: Mooloo⏎DATE ADDED: Jan 20, 2011⏎TRANSLATED BY: まだ⏎J-GO EDITED BY: まだ
-
are severe. Families may feel they do not have an opportunity to bid farewell. In areas where Ebola spread, community members often came to mistrust medical workers due to the lack of contact with dying family members. Here is
-
types, and the Rh group is either positive or negative. You blood groups help doctors know many things, like what kind of blood you’ll need in a blood transfusion or an organ donation, and if you or your baby will be in danger
-
to be that of legal interpretation with the help of the Final Record of the Conference and the preliminary texts (1).⏎PARAGRAPH 2. -- OFFICIAL TRANSLATIONS (2)⏎This provision too is an innovation so far as the Geneva
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 666, 666, 666, 666, 666, 666, 666, 666, 666,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
copyright?⏎You can transfer the economic rights of a unique and original work. You can do it under a license or a protocol.⏎A license transfer⏎- You can still profit financially from your work.⏎- You transfer the rights for a period of
-
robot to the appropriate human,” Woods said.⏎“The bottom line is, robots need to be responsive and resilient. They have to be able to protect themselves and also smoothly transfer control to humans when necessary.”⏎Woods admits that one thing is missing from
-
. Transfer hydrogenation catalysis (Figure 1) is a promising strategy for hydrocarbon reduction that occurs rapidly<|endoftext|>Raul Garcia-Patron Sanchez and colleagues find that quantum advantage is still some way off⏎Quantum advantage – the moment when quantum
-
the processing delay function of the warehouse has been mentioned. Generally, the warehouse with the product processing capability is become the processing warehouse.⏎(4) Transfer warehouse⏎The transit warehouse is in the middle of the cargo transportation system, and stores the goods
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:2059 suppresses
- L23:2516 excites
- L21:1820 suppresses
- L23:2769 excites
- L23:2565 suppresses
- L18:3057 excites
- L23:1722 suppresses
- L24:1216 excites
- L22:1652 excites
- L24:1554 excites
- L22:947 excites
- L24:1086 excites
- L6:1726 weakly excites
- L22:408 weakly suppresses
- L20:2559 weakly excites
- L8:2018 weakly excites
- L24:1063 weakly suppresses
- L21:1535 weakly suppresses 'Old' as part of a name or phrase
- L20:2929 weakly suppresses
- L23:1213 weakly suppresses
- L23:693 weakly suppresses
- L22:1386 weakly excites
- L16:2231 weakly excites
- L15:911 weakly excites
Feeds later layers
- L27:1348 strongly excites
- L27:2771 excites
- L26:3003 excites
- L26:1977 weakly excites
- L26:1164 weakly excites
- L26:1958 weakly excites
- L27:2057 weakly excites
- L26:933 weakly excites
- L27:1209 weakly excites
- L27:844 weakly excites
- L27:857 weakly suppresses
- L26:2828 weakly excites
- L26:3071 weakly excites
- L26:1668 weakly suppresses
- L27:3046 weakly excites
- L27:2134 weakly suppresses
- L26:1992 weakly excites
- L26:1396 weakly suppresses
- L26:2697 weakly suppresses word-start 'le' and 'log' pieces
- L26:2755 weakly suppresses
- L26:1315 weakly excites
- L27:470 weakly suppresses
- L27:2603 weakly excites
- L26:1686 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- trans
- Trans
- trans
- TRANS
- transfer
- (trans
- Trans
- -trans
- transfer
- →trans
Suppresses
- ội
- тив
- RICS
- voke
- �력
- ibili
- 息
- pillows
- 了一口气
- icut