end of document after a full paragraph

What this neuron does

This neuron responds strongly to the hidden end-of-text marker when it comes after a complete paragraph, so it seems to sense that one piece of writing has finished. Turning it up did not give a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   their . place. So, the students, teachers and other professionals finally had to resume their studies and jobs in government institutions like schools, colleges, courts etc.<|endoftext|>I hope you are all well and that you enjoyed some of your weekend in the

2. #2 peak

   own how to get there in the same way they landed the jet five years before.⏎So, there are lessons here:⏎- Without leadership from the top, bottom<|endoftext|>Updated: Jun 1, 2020⏎Jaundice is

3. #3 peak

   –6. Warsaw, 1877–82.⏎Pamiqtki Soplicy. Warsaw, 1961.<|endoftext|>Translate this page into:⏎Approach to family assessment and intervention⏎All India Institute

4. #4 peak

   i>⏎;; Now insert one character at the beginning of the buffer: (goto-char (point-min)) ⇒ 1 (insert "Q") ⇒ nil⏎<|endoftext|>A bead is a small bauble or jewel with a hole through its middle for

5. #5 peak

   to break down carbohydrates, proteins and fats.⏎You may have an idea, but there are many kinds of digestive enzymes that break down different kinds of food items.<|endoftext|>Chinese architecture started from ancient cave-dwellings, that are still inhabited on the

6. #6 peak

   editing nightmare and when the sorting is finished, it will put all of the blank spaces at the top of the list, leaving the data single-spaced anyway.<|endoftext|>A hydrogen atom falling on a neutron star surface from infinity releases 200

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Countess of Rosebery, died, at Dalmeny House, in Scotland, at the

2. #2 peak

   systems.⏎What is Lyra's demon?⏎lyra's demon, pantalaimon /ˌpæntəˈlaɪmən/, is his most beloved companion, whom he calls “

3. #3 peak

   10101100.0001000x.xxxxxxxx.xxxxxxxx SUBNET IP: 10101100.0001000x.xyyyyyyy.y

4. #4 peak

   Holiday Crowd At The Zoo⏎- The Child Is Father Of The Man (Es⏎Past Perfect Tense Interrogative⏎Had + subject + verb 3rd from + object.⏎Past Perfect Interrogative

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.