comma after a filler word

What this neuron does

This neuron fires on a comma that comes right after a small phrase like "well,", "however," or "oh,". It is quiet on words like "to begin with" and "more tragically". Turning it up or down gave off-topic text, so it does not tell us much about what it does.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   qualities that make it truly distinctive. The second character drawings are stronger structurally and easier to understand, but tend to look more regularized, streamlined and, well, normal.⏎The point is to be aware of the surprising shapes, lines and proportions

2. #2 peak

   many specific tick species within each of these categories. Some ticks are found across the United States. Others are limited to specific regions of the country. Thankfully, however, most ticks are fairly easy to identify.⏎Genus & Species⏎& Conditions Ca

3. #3 peak

   when some 5 million people were living with the disease. Since then, AIDS has killed more than 20 million people around the world and, this year, 40 million people are living with HIV/AIDS. In sub-Saharan Africa alone

4. #4 peak

   clusters; they are among the biggest coherent structures in the Universe (what’s bigger? Superclusters, which are clusters of clusters!). Imagine a collection of, oh, say, a thousand galaxies the size of the Milky Way. The sky inside one

5. #5 peak

   what appears to be an image of, well, absolutely nothing: a fascinating image of what appears to be a hole in the fabric

6. #6 peak

   makes them less worthy of attention, concern, and research money than, say, childhood obesity, which as we all know is public healthy enemy #1. (

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   can the climate generation do?⏎To begin with, business as usual is not an option. These young people are green entrepreneurs and

2. #2 peak

   's first pictures from the DC-8, posted to ESA's ATV blog, revealed a spray of fireworks similar to those seen during Mir's fall. More tragically, they also recalled what witnesses saw during the shuttle Columbia's breakup five years ago

3. #3 peak

   “Classroom flipping” was a hit, resulting in wide smiles on the murky faces of students and revival of new spirit of teaching in teachers.⏎· To begin with, classroom flipping requires that you reach to

4. #4 peak

   is a plant that is grown, among other things, for consumption and to make users ‘high’. Thus, we can safely call marijuana a drug.⏎To start with, marijuana, which can come from the cannabis Indica or Sativa species,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.