commas that lead into a continuation

What this neuron does

This neuron fires on a comma that comes after a finished clause, where the sentence is about to add more, like "...difficult to distinguish" or "...including the stomach." It dips on commas inside a list or title. Turning it up made the model repeat words like "which" and "as."

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   at least the most common variety of obsidian). However, sometimes obsidian isn’t as readily identifiable as you might think. It can grade into other rock types, making it difficult to distinguish.⏎Perhaps you have found a less common variety that doesn

2. #2 peak

   innovative drugs have been introduced, from Pfizer's (<|endoftext|>Information identified as archived on the Web is for reference,

3. #3 peak

   have yielded highly successful results, as revealed by Yang. These triumphs pave the way for its maiden voyages

4. #4 peak

   refer patients to a surgeon when surgical treatment is needed. Many surgeons diagnose and treat disease through nonsurgical methods, but it is usually in an area of medical specialization in which they are considered experts

5. #5 peak

   to its Cold War importance, but it is yet underappreciated by contemporary policymakers. NATO faces threats from all directions, so how can the Alliance also pay attention to the North Atlantic? How can it

6. #6 peak

   technical skills are required only in the IT sector, or in office-setting jobs. But that’s not true. Some level of technical

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   of galaxy clusters; they are among the biggest coherent structures in the Universe (what’s bigger? Superclusters, which are clusters of clusters!). Imagine a collection of, oh, say, a thousand galaxies the size of the Milky Way. The sky

2. #2 peak

   free()⏎- Automatic variables left on the stack of languages like C or garbage collected in languages like Java.⏎Byers, Simon. Scalable Exploitation of, and Responses to Information Leakage Through Hidden Data in Published Documents, AT&T Research,

3. #3 peak

   posited answers to this question, whether directly - in the case of Plato and Plotinius - or through story - in the case of Homer.⏎Plotinus, having been a proponent of Platonism, naturally concurs with Plato,

4. #4 peak

   . Think of a world where you could selectively download your life’s memories- sights, sounds, experiences- onto a Blue-ray to show your grandkids (who, by that time, will have something better than Blue-rays). Imagine being able to

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.