semicolon joining clauses
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on semicolons that join one clause to a second, explaining part, in long sentences of prose. When it was turned up, the model's writing filled up with semicolons.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
pulling together genetic, historical and sociocultural factors. The paper aimed to explain why African Americans are more likely to abstain or drink less compared to European Americans; why those who do drink encounter more negative consequences; and which African American population is
-
. This aggravates some persisting challenges, such as the large number of unqualified preschool teachers or teachers that have not been trained to teach at the preschool level; curricula and pedagogies that are not adaptable to the various developmental stages of
-
commonly known as the draft. For those who are not aware, the draft is a system of conscription that enlists citizens into the military; the system is run using an online sign up form that assigns you a draft number
-
of the mouth – one on each side of the mouth. These small organs help the immune system trap bacteria, viruses, and other harmful toxins that we inhale; preventing illness. Though they perform such a valuable task in helping the body remain healthy
-
and inter-disciplinary efforts to create a sustainable society. In fact, achieving the goal of environmental, economic, and social sustainability is predicated on changing human behavior; the purview of Psychologists (reviewed in , see also [2,
-
Housing Act of 1954, however, introduced federal funding for rehabilitation-based approaches as well. This talk considers the motivations behind this more conservationist approach; the practical constraints to its wider-spread adoption; and its prevalence, character,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I. I, I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I. I.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
angular velocity is ω;⏎③ The blade rotates around its geometric center, and the angular velocity is ω 0, and the velocity is ω; on the premise that the cutter position q is equal to the blade radius r,
-
⏎t0=0; %set the initial time to zero⏎tend=1; %set the final time to 100⏎tspan=[t0
-
research brief focuses on the following questions: 1) How does time in spent in foster care affect a child’s chances of continuing to live in foster care; and 2) Is child age at the time of a maltreatment investigation associated with
-
achea (in male striped seals) or from the esophagus (in male walruses) and serve to alter the specific gravity of the body; and (4) in the sperm whale, a blind air sac about 1 cu
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:579 strongly excites semicolons joining two clauses
- L17:1069 suppresses
- L17:2027 suppresses
- L14:155 excites sentence-ending periods in prose
- L16:1078 suppresses
- L5:5 weakly suppresses digit after a label like paper or type
- L4:51 weakly excites
- L9:1675 weakly excites
- L17:1772 weakly suppresses
- L16:1130 weakly suppresses
- L9:819 weakly suppresses
- L17:519 weakly suppresses
- L16:2817 weakly excites
- L10:33 weakly suppresses
- L15:286 weakly excites
- L17:990 weakly excites
- L15:1473 weakly suppresses
- L12:2487 weakly suppresses
- L14:2819 weakly excites
- L13:2476 weakly suppresses
- L8:76 weakly suppresses
- L0:1488 weakly suppresses
- L10:2615 weakly suppresses
- L16:1040 weakly excites
Feeds later layers
- L27:347 strongly excites
- L26:421 strongly excites
- L21:351 strongly excites
- L20:373 strongly excites
- L23:171 suppresses
- L26:603 excites
- L20:206 suppresses
- L24:531 excites
- L24:378 excites
- L25:238 excites
- L27:958 excites
- L21:759 suppresses
- L25:318 excites
- L25:296 excites
- L21:233 suppresses
- L19:1130 suppresses
- L24:264 excites
- L23:100 suppresses comma or full stop ending a clause
- L23:201 excites
- L25:542 excites
- L25:297 suppresses
- L25:40 excites
- L20:637 suppresses
- L27:207 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ;
- ”;
- ;
- ";
- ';
- ;");⏎
- ;";⏎
- ();
- ;<
- ;"
Suppresses
- ⏎⏎
- ⏎ ⏎
- **⏎⏎
- **⏎
- ⏎ ⏎
- ⏎⏎⏎
- }⏎⏎
- ⏎
- ⏎ ⏎
- }⏎⏎