'and' joining two parallel items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'and' when it links two matching things, like two verbs, two numbers or two lists of items. When it was turned up, the model's replies did not clearly change in a way we could name.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
a lack of mouse cell lines that harbor the BRAF mutation that is so prevalent in human melanomas, and the cell lines that are available grow slowly in culture and are not representative of human melanoma cell
-
contractions at a cellular level, slows swimming in fish, and reduces muscular strength in mice, according to scientists at the University of California (UC) Davis, and the University of Colorado. UC Davis’s press release explains that the chemical
-
situation as “grim.” At present, Mrytle spurge has no predators to prune back its advance, and its hardiness allows the plant to out-grow and out-compete native plants. This, in turn, affects the organisms—from insects
-
learn about service to humanity. Couriers escorted guests safely through remote terrain, delivered medical supplies to remote outpost clinics, and helped nurse-midwives during home visits and births. Frontier has benefited tremendously from the 1,600 Couriers
-
in the past 20 years, and numbers of antelope species, such as hartebeest and oryx, have declined by 90 percent and 95 percent
-
a smaller one with less flesh. They come in a wide variety of colors--red, orange, purple, yellow--and can make a great statement in salads and pasta recipes.⏎Cherry tomatoes are small and typically about 1" around.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I want to make sure I have a list of the first, second, and third, I want to find out how to solve the problem. The problem is, I need to make a plan to create a model where I will start with
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
tocin is released in the brain. Commonly referred to as the “love hormone,” oxytocin plays a major role in forming bonds and trust with others. Produced in abundance
-
13: 2511. doi:10.1023/B:BIOC.0000048451.07820.9c⏎- 1.1k Downloads
-
68k-palmos-coff-gcc -v should report its version number to be (at time of writing) 22.214.171.124-kgpd-07109
-
Assignment Help in Classification Of Relays⏎Transtutors is the best place to get answers to all your doubts regarding classification of relays with examples. Transtutors has a vast panel of experienced in classification of relays electrical engineering tutors who can
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:845 weakly excites
- L4:416 weakly excites
- L5:1329 weakly excites
- L3:716 weakly suppresses
- L0:2475 weakly suppresses
- L2:1198 weakly suppresses
- L5:210 weakly suppresses
- L1:780 weakly suppresses
- L3:1239 weakly suppresses
- L5:226 weakly suppresses
- L3:1731 weakly excites
- L5:1964 weakly excites
- L3:773 weakly excites
- L4:1631 weakly suppresses
- L4:1546 weakly suppresses
- L0:868 weakly suppresses
- L1:1329 weakly suppresses
- L5:338 weakly excites
- L5:1025 weakly excites
- L2:455 weakly suppresses
- L2:1342 weakly excites
- L3:823 weakly suppresses
- L2:339 weakly suppresses
- L4:417 weakly suppresses
Feeds later layers
- L16:1545 suppresses
- L10:478 suppresses
- L9:16 suppresses unclear: periods inside numbers and names
- L11:132 suppresses period ending an opening topic sentence
- L19:344 suppresses periods ending explanations
- L14:153 suppresses
- L8:718 excites
- L7:259 weakly excites
- L27:228 weakly suppresses
- L8:583 weakly suppresses
- L20:518 weakly excites
- L9:161 weakly suppresses
- L15:1002 weakly suppresses periods ending claim sentences
- L15:380 weakly suppresses
- L11:1746 weakly suppresses
- L9:705 weakly suppresses
- L11:1025 weakly suppresses
- L8:740 weakly excites
- L17:1105 weakly suppresses
- L8:441 weakly excites 'or' linking alternatives
- L27:1084 weakly suppresses
- L19:94 weakly excites
- L15:1465 weakly excites
- L19:1072 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- its
- yes
- ko
- alte
- is
- true
- lo
- ot
- eut
- hu
Suppresses
- ibbon
- �试
- 公司章程
- 并将
- ⏎ ⏎ ⏎
- 我们将
- 并与
- 当我们
- 的规定
- 虽然