end-of-text token after finished articles

What this neuron does

This neuron mostly fires at the point where one web page or article ends and a new unrelated one begins. It also fires on a few ordinary word breaks in news-style writing. Its negative side is less clear, showing up on words like 'their' or 'the' in the middle of a sentence.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   pain) and seizures in some instances<|endoftext|>Gauss Sum Walks⏎This Demonstration shows two types of pseudorandom

2. #2 peak

   source of clean water, soap so they can stay clean, and a proper toilet to avoid contaminating water supplies. In many of Oxfam’s ongoing programs, our partners work on promoting good hygiene and sanitation to help people stay healthy even when

3. #3 peak

   turtles from the wild and sell them.) Because of her size, she was rescued and sent to a Missouri farm, which is where the Newport Aquarium found her.<|endoftext|>The hustle and bustle of the back-to-school season is starting to wind down

4. #4 peak

   York’s Metropolitan Museum of Art in 1983. The Designer died in Paris on June 1, 2008 from brain cancer.<|endoftext|>How do you get

5. #5 peak

   the U.S. Congress to agree on a carbon tax or cap, his idea has serious merit and deserves a broad discussion, especially as Congress reassess its budget priorities. This includes billions of dollars of tax breaks and incentives for oil and other fossil

6. #6 peak

   Unfortunately he died at a very young age, in 1938, which made it impossible for him to leave and extensive body of work behind. .<|endoftext|>|Siege of Jerusalem|⏎|Part of the First Jewish-Roman War|⏎

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   better!)⏎Newspapers and magazines⏎Writing utensils (markers, pencils)⏎Glue or tape⏎- Gather and look at newspapers for layout inspiration. Consider their design, the placement of

2. #2 peak

   and they had two children. Just a few years later, the young mother traveled to Rome to study under Maria Montessori. Impressed by Montessori’s revolutionary methods, Fisher worked to bring the Montessori Method to the United States

3. #3 peak

   "?⏎Yes, curling has been compared to chess by fans and detractors alike. Fans emphasize the strategy involved. Detractors claim that both sports are similarly long and tedious for

4. #4 peak

   such as a mobile or through your hotel.⏎- If you receive an email which appears to be from a family member or friend claiming to be in trouble look at the way the email is written, ask yourself whether the email sounds like it was written

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.