text boundary after a document break

What this neuron does

This neuron responds to the invisible marker that separates two unrelated web pages, especially right where a new page starts. Turning it up didn't produce a clear change in the writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   made many<|endoftext|>NSCAW, No. 19: Risk of Long-term Foster Care

2. #2 peak

   959,<|endoftext|>Everyone's heard about an apple a day. As one of the most popular fruits

3. #3 peak

   ,0<|endoftext|>Guidelines for Restoring Cultural Landscapes⏎Identifying, retaining and preserving

4. #4 peak

   7Availability: In StockCBD Stock No: WW265132<|endoftext|>Ophthalmologists work in hospitals and clinics on land and aboard ships.⏎Average Military

5. #5 peak

   718<|endoftext|>Women who have kids later on in life may live longer, according to the findings

6. #6 peak

   0240.<|endoftext|>By 2003, plenty of data suggested that pesticide drift was harming

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   soon after), it’s time the real experts divulge the dirty, little secret of Lincoln studies: We keep finding new evidence about the life of the 16th president, and some of it can be kind of shocking.⏎It’s worth

2. #2 peak

   less need for water, fertilizer and pesticides. Also, native plants are less likely to create environmental havoc should they "escape" from your garden, unlike aggressive invasives.⏎Native plants have an important role in the local ecosystem (community

3. #3 peak

   along the road to recovery. The rebound follows cuts to global emissions of chlorofluorocarbons and halons, which have been destroying the gase

4. #4 peak

   scientific and industrial communities have collaborated to find safe and economical replacements for chlorofluorocarbons (CFCs), the manmade chemicals implicated in

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.