commas in lists of names or items

What this neuron does

This neuron lights up on a comma that sits in the middle of a list, usually right after the third or fourth item, such as a list of countries, states or animals. When it was turned up, the model's replies became rambling and did not stay on one topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   was their objection to federal authority. On February 4, 1861, representatives from the seven states Alabama, Florida, Georgia, Louisiana, Mississippi, South Carolina, and Texas-that had already seceded from the United States met

2. #2 peak

   12 sectors.⏎Each player had 1 piece. The 7 pieces were, from center to periphery: Moon, Mercury, Venus, Sun, Mars, Jupiter, Saturn.⏎The 12 sectors represented the zodiac houses. Every

3. #3 peak

   wine, he commanded the seven eunuchs who served him – Methuan, Biztha, Harbon, Bigtha, Anagtha, Zethat and Karkas – to bring before him Queen Vashti,

4. #4 peak

   out our choices, too. As far as vegetables go, we’re told to choose from “all five vegetable subgroups: dark green, orange, legumes, starchy vegetables, and others

5. #5 peak

   loudspeaker, radio, TV, email, and cell phones. In addition to a warning signal, alerts are read in five languages: Japanese, English, Mandarin, Korean, and Portuguese (except for severe weather warnings).⏎Types of alerts relayed

6. #6 peak

   of Concern aims to reduce harmful exposures among Asian women of child-bearing age from sport fish consumption. We are recruiting Asian women from four ethnicities (Chinese, Filipino, Hmong and Karen) aged 18–50 years old. Focus

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   August 1879 (Eve of the Octave of the Assumption) in Knock, Ireland, three mysterious persons appeared. The one in the middle was immediately identifiable as the Blessed Virgin Mary, veiled, crowned and praying.

2. #2 peak

   . If you have a Low E coating you will see three flames reflected in the window. The center flame will be a different color than the outer<|endoftext|>In nature, there are various

3. #3 peak

   War, it was not until June 15, 1956 that one was adopted by the tribal elders. It consists of seven stripes, the central being 1/6 the size of the other stripes. The hoist consists

4. #4 peak

   new canvas in early 1916. Black is the principal agent, at once simplifying, dividing, and joining the three zones of the canvas: the still life of melons and leaves on a gridded pavement, bottom left

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.