line breaks after numbers or fragments

What this neuron does

This neuron fires on the line break that comes after a number or a short, cut-off fragment at the end of a line, often in lists, page numbers or headings. Its negative side is weaker and falls on words like 'day' and 'boating'. Turning it up did not produce a clear theme in the written text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   1,2⏎Whether it be driving the kids to extracurriculars, getting up at

2. #2 peak

   University, USA⏎"TEEB brings a rigorous economic focus to bear on the problems of ecosystem degradation

3. #3 peak

   ahead of formal qualifications’. 1⏎Research by the Institute of Leadership and Management with Ashridge Business School suggests that over

4. #4 peak

   half, and half again, to⏎make four smaller rectangles. How many different ways can you fold⏎This problem focuses

5. #5 peak

   On the other side, they⏎should write one sentence about Abraham Lincoln's life. After the penny is⏎created

6. #6 peak

   3⏎Scientists learning what it takes for seals to live in the wilds of Antarctica⏎

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   <|endoftext|>For most of his writing career, Vladimir Nabokov was frustrated by both the Freudian and behavorialist schools of psychology that reigned in his day, seeking a richer and more complex view of the mind than either provided. In

2. #2 peak

   was replaced by the St. Lawrence Seaway which opened in 1959. In 2002, Lachine was reopened as a boating recreational area. An environmental reclamation project continues to clean up the polluted canal.⏎

3. #3 peak

   would do<|endoftext|>Printed on a large, single sheet of paper (thus ‘broadside’), these cheap, everyday publications were the popular songs of their day, reaching the height of their popularity in the 1660s.

4. #4 peak

   sheriff’s department, registry of deeds, and courthouses.⏎Portland harbor is a working waterfront serving tankers, tourists, and fisheries, along with recreational boating from year-round and summer residents. Ferries connect the mainland to the many Cas

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.