comma in lists before "and" or "nor"

What this neuron does

The neuron lights up on a comma that comes right before the last item of a list, like "chemicals[,] and UV radiation". It is less active on the word "nor" that follows a negation. Turning it up or down made the model's writing shift topic without a clear shared theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   and a portion of the Great Eastern Trail. The historic Civilian Conservation Corps (CCC) built many of the trails.⏎With foresight, good judgment, determination, and your help⏎we can ensure that this unique, natural area will continue to

2. #2 peak

   methodological aspects of WWC reviews and reports.⏎The WWC is committed to ensuring that its products and services meet user needs and invites input from educators, policymakers, researchers, and members of the public. All products are available through the WWC

3. #3 peak

   inghouse (WWC) was established in 2002 by the U.S. Department of Education's Institute of Education Sciences to provide educators, policymakers, and the public with a central and trusted source of scientific evidence of what works in

4. #4 peak

   seek a new relationship with the continent. But in the complex world of post-colonial relationships, such a move is difficult. France retains strong economic, political, and social links with West Africa. Paris, Marseille, and Lyon are home to

5. #5 peak

   has temples, monasteries, and priests who make offerings, meditate, and perform other rituals for their communities. One of the main ideas of Taoism

6. #6 peak

   .<|endoftext|>Newegg.com - A great place to buy computers, computer parts, electronics, software, accessories, and DVDs online. With great prices, fast shipping, and top-rated customer service - once you know, you Newegg.⏎If you

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   for some. One worker left the following anonymous note when she left:⏎“I am going home where I shall not be obliged to rise so early in the morning, nor be dragged about by the factory bell, nor confined in a close noisy room from

2. #2 peak

   the bright morning and the stillness of night, he has been reassured, so as to say: "Your Lord has not at all forsaken you, nor is he displeased with you." Then, he has been given the good news

3. #3 peak

   students can’t learn if they are distracted by hunger in the classroom, nor can they<|endoftext|>It's time for another tour of international food-borne and water

4. #4 peak

   “We don’t see everything Israel does as holy, nor what the Arab states or Palestinians do…. It’s not as if we say,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.