document start marker token

What this neuron does

This neuron reacts to the hidden end-of-text marker that separates documents, which appears at the start of a new passage. Its effects on the model's writing were not clearly readable from the steering results.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   <|endoftext|>House in Space, from a NASA Remix Challenge. Credit: Cookieater20

2. #2 peak

   <|endoftext|>10 Tips for Parents of Prospective College Students⏎1. Choosing a Career

3. #3 peak

   <|endoftext|>Active transportation refers to non-motorized transportation modes, such as bicycling and

4. #4 peak

   <|endoftext|>Public holidays in Pakistan are different than bank holidays in the country. While all of

5. #5 peak

   <|endoftext|>Philosophy East and West 46 (2):143-

6. #6 peak

   <|endoftext|>Cancer & Tumorigenesis⏎Cancer describes the disease with un

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   1 LED per segment and a decimal point.⏎Here is the pinout of a fairly typical display, you should always refer to the datas

2. #2 peak

   government has taken no chances, shutting down parts of the city for rehearsals and tightening security as it readies for a show of might and pageantry.⏎Here is what the anniversary is about and what will happen.⏎Rebirth from civil war⏎

3. #3 peak

   and sustainable – it would fall apart. Just as women enjoy a set of rights upon their husbands, husbands also possess certain rights over their wives in return.⏎Here is a look at some of the rights possessed by a husband in the realm of Islam

4. #4 peak

   , I would ensure that there is a collaborative element; either have students work in partners working towards the same class puzzle.⏎Here is a link to a few puzzle ideas put out there by Quora members.⏎Pr

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.