line break in the middle of a sentence

What this neuron does

This neuron fires on a line break that cuts a sentence in two, the kind you see in text that was wrapped at a fixed width (like old printed articles). It is most active where the sentence is clearly unfinished at that point. Turning it up gave text that does not obviously relate to this.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   policy shifts in member states,⏎such as Greece, Italy the United Kingdom and Ireland. The Multireader⏎project examined complex navigation through digital materials, and the⏎TEDUB project covered a similar area for graphical information

2. #2 peak

   Site 48TE414 is in the South Jenny Lake development. The site was⏎recommended as eligible for the National Register of Historic Places. The⏎National Park Service and

3. #3 peak

   and heavens shall be replaced by a new earth and new heavens; a new⏎world will then come into being. All mankind shall be raised up there and shall⏎be rewarded or punished on the basis of their beliefs and deeds.”⏎In this article

4. #4 peak

   .⏎The ceiling limit for a family consisting of five members was fixed as 30⏎standard acres. For every additional member of the family consisting of more than⏎five members, an additional extent of

5. #5 peak

   99⏎African American Nurses have long history with the American Red -⏎Undeterred by initial rejection, Davis persisted and in l9l7 became the⏎first

6. #6 peak

   plantation after getting permission from the Land⏎Board under section 31 of the Act.⏎Ceiling laws were enacted and enforced actually in two phases, the earlier⏎

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   which ids full of⏎violence and hatred, wreaking havoc on their towns to express their beliefs.The Oklahoma City bombing brought home to American people that no country⏎is immune from terrorism.⏎Although thought to be tied into larger extremist⏎groups,

2. #2 peak

   the⏎notes are a summary and a detailed analysis of the⏎poem's plot, theme, genre, purpose, context, references and techniques. The original⏎text appears after the notes. For "deep explorers" of Anglo-Saxon

3. #3 peak

   <|endoftext|>Lecture by Francesca Russello Ammon, Associate Professor of City & Regional Planning and Historic Preservation, Weitzman School of Design, University of Pennsylvania⏎By 1965, nearly

4. #4 peak

   sharing, and rapidly publishing scholarly content on the Web.” It is not simply a Web site that hosts textbooks, articles, and courses. A non-profit run by⏎“Most textbooks are a mass of information in linear format: one topic follows after

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.