'Holy' in names like Holy Land
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'Holy' when it is part of a name, such as Holy Land, Holy Roman Empire or Holy Family. It is weakly negative on the word 'Great' in The Great Gatsby. Turning it up or down gave text that did not relate to religion or names.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
biggest fear is to see our brothers and sisters starving and without any assistance. Acts and decrees of the Second Plenary Council of the Philippines: held at the Holy Apostles Seminary, Makati, Metro Manila from 20 January-
-
. This traditional Mexican liturgy is celebrated throughout the Catholic Southwest during the last nine days of Advent, a kind of public ritual theater. People accompany statues of the Holy Family from house to house around the barrio, waiting to be recognized and allowed
-
see that the success of the Church⏎has largely been dependent on national factors. Contrast, for instance,⏎the history of the Holy Roman Empire with that of the British Empire.⏎Without the temporal power of this material
-
Zucchino, previously a reporter and foreign correspondent for the The Philadelphia Inquirer, The<|endoftext|>On November 8th, we commemorate the Synaxis of the Holy Archangels and all the Bodiless Powers. This is a special time to
-
near Bethlehem with his wife, Celeste,⏎and their six children. (They're expecting number seven.)⏎A cantor who is also active in the parish's Holy Name Society,⏎Behe still sees no conflict between faith and evolution, but is
-
,” which became the seat of the theological faculty of Paris, the most illustrious seat of learning in the medieval period.⏎He led the Seventh Crusade to the Holy Land in 1248–50 and died on
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: when I was in high school, I was also going to go to the same school where I was also going to go to the same then when I was also going to go to the same then when I was also going to go to the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
etc.), appears in Greek and Latin satires from the late first century. In the sexuality of the ancient Romans, a tribas was a woman or hermaphrodite who actively penetrated another woman. Until
-
. Therefore, the author supports the vision that intense pursuit of success by the individual leads to their corruption and ultimately a more corrupt society. In the novel, The Great Gatsby, Fitzgerald has a pessimistic vision of America and his depiction is that
-
part decadence, excess, and disillusionment. Being wealthy is certainly one of the main accomplishments that characterized the American society. Through his characters, the novel The Great Gatsby by F. Scott Fitzgerald reveals the consequences of this dream on the population
-
to bring them all into existence on day four of Creation with the word of His mouth.⏎“By the word of the Lord the heavens were made, and all the host<|endoftext|>Oxcarbazepine prevents fits.⏎Take it regularly, twice
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2548 weakly excites
- L14:2288 weakly excites
- L13:484 weakly excites
- L20:361 weakly excites
- L19:427 weakly suppresses
- L9:2717 weakly suppresses
- L17:985 weakly excites
- L6:1458 weakly suppresses
- L7:1249 weakly excites
- L4:2714 weakly suppresses
- L17:1971 weakly excites
- L20:303 weakly suppresses
- L1:1913 weakly excites
- L0:1814 weakly excites
- L16:2385 weakly suppresses
- L17:1690 weakly excites
- L21:48 weakly suppresses
- L21:2748 weakly suppresses
- L13:790 weakly excites
- L2:70 weakly excites
- L9:1019 weakly excites
- L16:792 weakly excites "the" inside a prepositional phrase
- L19:2875 weakly suppresses
- L11:130 weakly excites
Feeds later layers
- L27:1099 weakly suppresses
- L27:2392 weakly suppresses
- L25:1682 weakly excites
- L27:754 weakly suppresses
- L24:628 weakly suppresses
- L25:2540 weakly suppresses
- L27:1005 weakly suppresses
- L25:662 weakly excites
- L24:473 weakly suppresses
- L24:961 weakly suppresses
- L24:2188 weakly suppresses
- L24:2222 weakly suppresses
- L26:2018 weakly suppresses
- L27:1865 weakly suppresses
- L25:1801 weakly suppresses
- L27:2346 weakly suppresses
- L25:2774 weakly suppresses
- L25:2482 weakly excites
- L24:1898 weakly excites
- L27:1541 weakly excites
- L27:1897 weakly suppresses
- L24:1201 weakly excites
- L24:2742 weakly excites
- L25:1101 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- imon
- pose
- _FOUND
- 存在
- man
- 职
- ifter
- counter
- _stub
- 很
Suppresses
- undos
- OMP
- adiens
- beth
- 何时
- 也不例外
- rowave
- ()=="
- ��
- →glUniform