comma linking two clauses after 'and'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to a comma that comes right after a word like 'and' when it joins two full sentence parts, such as 'X, and, in some cases, Y'. When it was turned up, the model's writing fell into long loops of repeated words like 'and, and, and' or 'you, you, you'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
? There are only three species of venomous snakes living in the wilds of New York (many other kinds may be found in the homes of private individuals and,
-
briquettes, known as yeontan. For decades, these briquettes kept Korean houses warm in winter. They were seen as a valuable commodity and, at some point, an embodiment of technical progress.⏎Heating has always been a
-
greater freedom in operations, in return for higher performance goals and academic results specified in their contract, or “charter,” made and agreed upon by school leaders and, in IDEA’s case East Baton Rouge district officials.⏎How is IDEA funded and are
-
to land in Plymouth previously, employing four aircraft and dozens of naval ships to mark the way. What marked this flight out was that it was non-stop, and, taking less than 72 hours was eligible for the Daily Mail prize.⏎There
-
soccer with miniscule figurines in painted-on soccer outfits, mounted on rods that are manipulated from the sides of the table. You can move these rods and, thereby, the “players” right and left to the field and rotate them
-
.⏎- In the case of Col. Shaw, it seems that he chose to live his life a certain way (leading his African American troops into battle) and, now that he's dead, he's off on the sidelines, checking out all
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the value of $ \sum_{k=0}^{n^{2} r^{2} l^{2} t^{2} \ 0 1^{2} 1 0 1 2 0
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
deal with every issue on the summit agenda. What follows are a few examples of the challenges and innovations under discussion.⏎Access to Education⏎At the most fundamental level, the world has still not achieved the commitment made by the world’s governments to provide
-
things that ordinary people just can’t!”⏎The appeal of such a dismissive explanation is that it excuses us from living, and perhaps even dying, if necessary, like Father Delp<|endoftext|>Hachiman is in the far south-east of Kh
-
ogy, which explores issues relevant to learning and teaching mathematics-in-context, thus providing a valuable practical tool for general mathematics education research. The most important goal, then, is to exemplify the merging of the theory with practice and the subsequent applications to
-
put together from Continental Europe, British Isles, and American building blocks in Southeastern Pennsylvania. While this culture is a unit linguistically, and in most other ways, it is divided down the middle by religion. The "two worlds" are those
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:1615 excites
- L14:35 suppresses
- L15:241 excites
- L9:77 excites commas in citations and name lists
- L4:3 excites commas after citation fields
- L5:16 excites
- L10:856 excites
- L11:154 suppresses commas after citation numbers
- L6:250 excites
- L9:1113 suppresses
- L14:51 excites colon that introduces a statement
- L0:2921 suppresses
- L10:335 excites commas in catalog, date, and list metadata
- L7:288 excites
- L15:1213 suppresses
- L15:1772 suppresses
- L5:454 suppresses
- L10:1459 suppresses
- L3:71 suppresses
- L15:123 suppresses
- L15:1128 excites
- L2:66 excites
- L1:1 excites
- L15:630 suppresses
Feeds later layers
- L17:1772 suppresses
- L18:1394 suppresses
- L26:236 excites
- L17:1405 suppresses
- L19:682 excites
- L21:700 suppresses comma before a new clause
- L17:116 excites
- L17:757 excites
- L19:1036 excites
- L17:2001 suppresses
- L27:191 excites
- L17:348 excites
- L27:86 suppresses
- L19:726 suppresses comma inside large numbers
- L17:2413 suppresses
- L26:22 suppresses the 'res' fragment inside words
- L22:368 excites
- L20:173 excites
- L23:184 suppresses
- L25:328 excites
- L19:1506 suppresses
- L25:438 excites
- L19:2645 suppresses commas in the middle of a sentence
- L18:862 excites hedges like 'it turns out' and 'if any'
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ,
- #,
- -down
- !,
- ,
- ees
- ,在
- 下去
- ,#
- geois
Suppresses
- можете
- '),('
- 냅
- 他们的
- 请您
- 除非
- 但是如果
- ⏎ ⏎ ⏎
- 您可以
- 您的