'and' joining two words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'and' when it links two things of the same kind, like 'women and girls' or 'legal and regulatory'. When it was turned up, the model fell into repeating phrases such as 'and that, and that'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
2 million people a year, most of them women and children. Thisremains a major health concern and equitable human development cannot be achieved as long as women and girls continue to lack access to modern energy sources. Clean and efficient cooking energy has
-
women who lost weight. Those hormone levels dropped 16.2 percent in women who dieted and 20.3 percent in women who dieted and exercised, according to the study.⏎"The biggest effect was through diet
-
this report, the different legal and regulatory frameworks for the travel and tourism sector are considered which affect the business. Surface, sea and air transport laws within the legal and regulatory
-
not read nor write but spoke Irish and English. Margaret could read, write and spoke both Irish and English and Julia could not read nor write but both spoke Irish and English. All were born in County Galway.⏎There were three new columns in
-
and college faculty. Many career and technical education programs include opportunities for you to continue your learning in the community through service or employment.⏎To find out more about career and technical education programs of study, talk to your counselor or career and technical education teacher
-
History proves that dictatorships do not grow out of strong and successful governments, but out of weak and helpless ones. If by democratic methods people get a government strong enough to protect them
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it is not, and it is not. It is not, and it is not. It is not, and it is not, and it is not, and it is not, and it is not, and it is not, and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
they are not invited. The master notes that the people of Dis city have “eternal fire that burns inside them…” (Inferno 8, line, 73). This is meant to warn the narrator that the city dwellers
-
7, 72, 76, 77, 81, 86. Our estimates predicts 32 members of this sequence starting from 6.
-
cost you to fulfill those orders?⏎If it cost $15,000 to print, store, and ship them to your customers, another $5,000 to maintain your website, $3,000 in miscellaneous
-
1918-College of Dentistry organized in Dallas by taking over the State Dental College which had been founded in 1905.⏎1971-The College was separately incorporated in 1971, although Graduate programs
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:313 excites "and" joining paired nouns
- L1:1250 weakly suppresses
- L2:193 weakly suppresses
- L2:334 weakly suppresses
- L1:17 weakly suppresses
- L1:1710 weakly suppresses
- L0:2719 weakly suppresses
- L1:8 weakly excites
- L2:184 weakly excites
- L1:2816 weakly suppresses
- L0:2770 weakly excites
- L1:2867 weakly excites
- L0:558 weakly suppresses inside all-caps abbreviations
- L1:359 weakly excites
- L1:298 weakly suppresses
- L1:1583 weakly excites
- L2:356 weakly excites
- L1:3037 weakly suppresses
- L2:86 weakly excites
- L1:1122 weakly suppresses
- L0:519 weakly excites
- L1:923 weakly suppresses
- L1:98 weakly excites
- L0:2452 weakly excites
Feeds later layers
- L4:155 strongly excites
- L5:44 strongly excites
- L4:559 strongly suppresses
- L10:350 strongly excites
- L5:119 strongly excites
- L4:497 excites
- L6:879 suppresses
- L6:169 excites
- L6:212 excites
- L4:483 excites
- L7:85 suppresses
- L5:29 excites
- L7:222 excites
- L6:277 suppresses
- L6:571 suppresses
- L6:258 excites
- L10:35 excites
- L8:82 suppresses
- L5:42 excites
- L5:88 excites
- L8:73 excites
- L7:27 excites
- L6:235 excites
- L5:107 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 他们
- 器材
- 的那个
- 的日
- 另外一个
- 筏
- 他们是
- ឡ
- FLT
- lickr
Suppresses
- Enough
- ends
- pering
- روس
- Vtbl
- endez
- vis
- zeitig
- ended
- urgeon