line-break tokens inside wrapped text

What this neuron does

This neuron mostly fires on the hard line break in text that was copied with fixed-width line wrapping, where a sentence is split across lines in the middle. The steering results show no clear link to this, so the effect is weak and hard to read.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   The Treaty Oak has also played an important and romantic part in the history of the Lone Star State. One

2. #2 peak

   As India dissented over⏎the US actions in Vietnam, the US offered technology as well. This⏎technology added another element that made the situation in India much⏎different and more difficult to assess than that under the British⏎Mercantilism

3. #3 peak

   nitrogen-fixing bacteria⏎and the roots of the plants in which they live, and are examining⏎how synthetic chemicals might interfere with these signals. Disrupting⏎these 'signals of life' could have important ecosystem impacts.⏎developing fetus is

4. #4 peak

   that: ethnically, they are the descendants of the ancient inhabitants⏎of Mesopotamia; culturally, they are the heirs of their Aramaic language⏎To be accurate from the start, I must add this clarification:⏎1) the

5. #5 peak

   seven at the most. Atop that, the immigrants usually collected into⏎a few identifiable regions.⏎Consider the new states largest single immigrant group. Oklahomas⏎first decennial federal census, taken in 1910, calculated that

6. #6 peak

   and⏎the occasion will be celebrated as a sign of the boy's passage into maturity⏎and promising future. A significant event in the culture and history of South⏎India is known as the Dhoti Ceremony. This is a momentous day

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   It’s amazing to keep in touch with everybody and see some amazing work being produced.⏎We hope

2. #2 peak

   culture. As a whole, these examples illustrate the three kinds of discourse at which rhetoric is aimed.⏎Oxford Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and

3. #3 peak

   the many countries whose citizens have used SOHO to chase comets.⏎Almost all of SOHO's comets are discovered using images from its Large Angle and Spectrometric Coronagraph (LASCO) instrument. LASCO is used to observe the

4. #4 peak

   when elements cannot be saved, field biologists help bring back species and their ecosystems (restoration biology).⏎Chicago Scholarship Online requires a subscription or purchase to access the full text of

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.