comma opening an interrupting phrase

What this neuron does

This neuron fires on a comma that comes right after a subject and starts an extra aside, such as the comma after 'the Senate' in 'the Senate, part of the legislative branch, approves'. Turning it up made the model produce strings of 'which, that, the' with no real sentences.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   213 species in the continent, or about 9 percent of the Earth's freshwater fish diversity. At least 57 North American species and subspecies, and 3 unique populations, have gone extinct since 1898,

2. #2 peak

   formations. All adults must get at least minimal levels of vitamin D to absorb sufficient calcium to maintain healthy bones. Postmenopausal women and the very elderly, who are at elevated risk of osteoporosis, may need supplemental vitamin D to

3. #3 peak

   from the very beginning. Immediately after declaring the curse on Adam and Eve, God killed an animal to provide clothing for them. Every significant event in the Old Testament, either preceded or followed animal sacrifice. God didn’t demand this

4. #4 peak

   which can lead to diarrhea.⏎As a registered dietitian who specializes in the low FODMAP diet approach, I can help you determine which FODMAP foods, and how much of them, you can tolerate. The goal will be to provide

5. #5 peak

   at evening gatherings, around the communal fires in the village or at hunting camps. Young boys would learn the easier stories and accompanying designs, but only the storytellers, who were highly esteemed for their knowledge, and formed an elite, knew many more

6. #6 peak

   fruit, and lactose, or milk sugar, come from sources that benefit your diet. However, the sugars and syrups added during food processing and preparation, called added sugars, are viewed as a detriment to a healthy diet. Maximizing

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Temple of Baalshamin (god of fertility) — and a monumental arch that opens onto a 1,200-meter (3,937 ft.) long colonnade, the center of this shining cultural beacon.⏎In

2. #2 peak

   tight state grip on the media, books and films severely limits freedom of expression. Digital space offers an affordable, accessible, and, if desired, anonymous, soapbox far freer than its terrestrial counterparts. So moving there

3. #3 peak

   which is in faith (1 Tim. 1:4; cf. Titus 3:9). In the modern church, however, many—if not most—believers who are reading Scripture are prone to skip over the genealogical

4. #4 peak

   income and improve our lives.”⏎In Cayos Cochinos, these projects would not have been possible without Anthony Ives. A former San Francisco stock trader who at one point was managing 50 billion dollars for the state of California, Ives

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.