the 'trans' word fragment
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the piece 'trans' when it starts the second half of a longer word, as in transshipment, transdermal or transacted. When it was turned up, the model started producing strings of 'ant' fragments and then looped on them.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
capability is become the processing warehouse.⏎(4) Transfer warehouse⏎The transit warehouse is in the middle of the cargo transportation system, and stores the goods waiting for transshipment. The general cargo is only temporarily parked here. This type of warehouse is
-
of U.S. trade sanctions against it. Dubai can also be called an entrepot.⏎Now, what is an Entrepot?⏎An entrepot is a trans
-
CD11/CD18 proteins. We have developed an in vivo model for gene therapy of LAD. Recombinant retroviruses were used to transduce a functional human CD18 gene into murine bone marrow cells which were
-
opause but can also develop in younger women.⏎Doctors use a variety of tests to diagnose uterine and endometrial polyps. The first test is a transvaginal ultrasound. This is done vaginally using a wand-like device that
-
ships are sent with large numbers of troops and materiel to reinforce Europe, they must cross Atlantic waters infested with Russian submarines, surface vessels, or aircraft that transited south through the gap. It is here that the geographies of North America
-
on an electric field. It drives a charged substance, usually a medication or bioactive agent, transdermally by repulsive electromotive force, through the skin. A small
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: In the last 24 hours, I have seen a great number of non-overserved non-overservededingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingedingeding
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
mass movement for the liberation of Dalit society. He knew that through struggle they would get their rights on one hand and at the same time a sense of self-respect would also be awakened within the downtrodden section who had been suffering for
-
of the cash deposited in its system. Rather, the bank has its capital invested or on loan elsewhere, which is how the bank generates its income. Called fractional-reserve banking, banks loan out money based on the amount of deposits they have.
-
what you believe you are entitled to.⏎We need more taxpayers, not more people depending on government and definitely not those with entitlement mentality.⏎– lack of responsibility;⏎Responsible individuals are not really comfortable depending on
-
RC-5) vaccines have their origin in induced abortions. Among these vaccines we find the following: rubella, measles, mumps, rabies, polio, smallpox, hepatitis A, chickenpox,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:151 weakly suppresses
- L22:164 weakly suppresses
- L20:472 weakly excites
- L8:1661 weakly suppresses
- L23:206 weakly suppresses
- L5:265 weakly excites
- L1:1585 weakly excites
- L17:1125 weakly excites
- L16:811 weakly suppresses
- L20:959 weakly excites
- L18:1741 weakly excites
- L4:1042 weakly suppresses
- L6:3062 weakly excites
- L17:867 weakly suppresses unclear: punctuation before an explanation
- L14:2420 weakly excites
- L7:791 weakly suppresses
- L20:2013 weakly suppresses
- L16:892 weakly excites
- L8:2483 weakly excites
- L15:2328 weakly suppresses
- L19:1351 weakly suppresses
- L5:1273 weakly excites
- L4:1184 weakly suppresses
- L9:2719 weakly excites
Feeds later layers
- L27:203 weakly suppresses
- L26:1615 weakly excites
- L26:1164 weakly excites
- L27:1725 weakly suppresses
- L27:618 weakly excites
- L27:1583 weakly suppresses
- L27:787 weakly suppresses
- L25:666 weakly suppresses
- L27:1591 weakly excites
- L26:578 weakly suppresses
- L25:2083 weakly excites
- L25:1386 weakly excites
- L25:507 weakly excites opening parenthesis after a phrase
- L27:878 weakly suppresses
- L26:984 weakly suppresses
- L26:1854 weakly suppresses
- L25:462 weakly suppresses
- L25:1396 weakly excites
- L25:315 weakly excites
- L25:1895 weakly excites first digit of a year like 2020
- L25:2259 weakly suppresses
- L25:313 weakly suppresses
- L27:1034 weakly suppresses
- L25:1616 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ant
- ANT
- ant
- face
- ante
- anter
- ants
- antly
- antor
- Ant
Suppresses
- essions
- olutions
- ius
- erving
- есс
- �试
- 什么原因
- erved
- iliary
- IOUS