line breaks mid-sentence

What this neuron does

This neuron fires on the invisible line break inside a sentence, where a line of text has been wrapped or split in the middle of a thought. The examples mostly come from text copied from PDFs or web pages with hard line wraps. Turning it up did not produce a clear theme in the replies.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Understanding antonyms is part of vocabulary development and this worksheet offers good practice with antonyms there are some synonyms and other words mixed in too so it s important that This video first appeared as a facebook live on 15th october download a

2. #2 peak

   actual practice that difficulties could⏎be resolved by discussion as they could not be resolved by force. Moreover,⏎the British Commonwealth was founded on the conception that war between⏎

3. #3 peak

   as the uprising⏎of the British Empire. But we have no right to this position of special⏎and honorable responsibility unless we are determined to use it to the⏎full, not for our own

4. #4 peak

   has said⏎that he would not have one Christian missionary in India if he rose to⏎power. And if the Zionist Jews became the governors of Palestine all missionary⏎work there

5. #5 peak

   4. While the crops⏎could produce incredible yields when properly managed and with plenty of⏎water, doing so reduced the water table, added salt deposits to the⏎land, and made portions of the land unsuitable for

6. #6 peak

   policy shifts in member states,⏎such as Greece, Italy the United Kingdom and Ireland. The Multireader⏎project examined complex navigation through digital materials, and the⏎TEDUB project covered a similar area for graphical information

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   it was her own foolish choice and actions that lead to her and Romeo's death. Though the death of Romeo and Juliet was a tragic love story of two star-crossed lovers, caused by their families and friends, more specifically Friar Lawrence,

2. #2 peak

   580.3 m (1,904 ft), bears the name of the Scot who discovered it in 1880. William Sutherland was one of several Scots who explored the country in the 19th century

3. #3 peak

   for those that don’t have the ability to move to another state, the college they wish to attend is just a few mouse clicks away.⏎Is this where grade-school level education is headed? I can’t say for certain that is the case,

4. #4 peak

   shapes - single, semi-double and double-flowered - is enormous. There are geraniums that can reach a height of one metre, but also creeping groundcover which only grows to a height of 10cm and hanging varieties which can

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.