commas in the middle of a sentence
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on commas that sit in the middle of a sentence and leave the thought open, such as a comma before a list item or a clause that is still going. It is hard to pin down more exactly. Turning it up made the model write long lists joined by commas and "and," and turning it down made it produce lists of letters.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
<|endoftext|>The thing I love most about history is its quirky little pieces. Don’t get me wrong- names, dates, and places on a map are all important, and provide a
-
see the cervix and the inside of the uterus.⏎- Laparoscopy. This minor procedure uses a laparoscope, a viewing instrument with a light, to see your uterus and pelvis. The laparoscopy is inserted through
-
[Insert Poem Title] is no exception. Through her vivid descriptions and thought-provoking themes, Oliver encourages readers to pause, appreciate the beauty of nature, and
-
without counting calories and without ramping up your exercise routine,â saysNeal Barnard, M.D., lead author of the study, president of the Physicians Committee, and an adjunct associate professor of medicine at the George Washington University School of Medicine and
-
aviolet to be effective, engineers say.⏎That puts those wastewater permit holders in a bind: The law requires them to disinfect, often a costly and complex affair, but their current<|endoftext|>Most of you probably don't remember. I don't,
-
in the fume hood). Furthermore, it is best to keep the work space neat and clean in all laboratory operations, particularly those involving the use of hoods, so that any procedure or experiment can be undertaken
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as, as,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
make much difference anyway. The best approach is an honest one that doesn’t try to offer a college course in human reproduction in one session. Tell the child that, in a sheltered place inside their bodies, mothers carry a large number of tiny
-
typically used to deposit metals or weak insulating materials (such as most nitrides). However, a buildup of insulating material next to the plasma racetrack, and the consequent charging effect of the ionic bombardment, often initiates
-
progresses. Among the most important early decisions is whether the needs of the specific clinical trial protocol would be best served by combining all materials in a single kit or if, owing to temperature control and other concerns, it would be more appropriate to divide components
-
longer used talc with asbestos. The safety of asbestos-free talc, which is still widely used in many products, is less clear and has been possibly
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:240 strongly excites comma after 'sometimes' or 'the truth'
- L14:35 suppresses
- L18:1404 excites
- L18:1403 excites
- L17:118 excites comma after a clause ending
- L16:650 suppresses
- L18:366 excites comma inside numbers and dates
- L15:2506 excites
- L15:841 excites
- L18:1394 excites
- L4:3 excites commas after citation fields
- L15:2961 excites
- L15:2235 excites
- L5:16 excites
- L10:335 excites commas in catalog, date, and list metadata
- L16:2905 excites
- L11:154 suppresses commas after citation numbers
- L9:77 excites commas in citations and name lists
- L16:1788 suppresses
- L17:1405 suppresses
- L16:1082 suppresses comma linking two clauses after 'and'
- L17:207 suppresses
- L15:1159 suppresses ampersand in citation author lists
- L15:3010 suppresses
Feeds later layers
- L21:344 strongly suppresses
- L20:173 strongly suppresses
- L27:86 strongly excites
- L24:6 strongly excites
- L26:236 strongly suppresses
- L20:276 strongly suppresses
- L26:22 strongly excites the 'res' fragment inside words
- L27:286 strongly suppresses
- L20:82 strongly excites
- L24:642 strongly suppresses
- L24:572 strongly suppresses
- L27:575 strongly suppresses
- L25:438 strongly suppresses
- L24:304 suppresses
- L26:491 suppresses
- L24:216 suppresses
- L23:49 suppresses
- L25:381 suppresses
- L25:328 suppresses
- L26:2123 suppresses
- L25:969 excites
- L27:191 suppresses
- L24:468 suppresses
- L20:2891 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- "
- 而出
- eph
- ']/
- "]
- "]/
- "/
- }
- ”
- ∷
Suppresses
- (),
- [],
- ++,
- **,
- ?,
- %,
- (),
- !,
- ``,
- ~,