the end-of-text token after a finished passage

What this neuron does

This neuron fires on the invisible marker the training data uses to show that one document has ended and a different one begins. Turning it up gave text that did not obviously relate to this job, so its role beyond the marker is unclear.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   to ask you another question. What is something you can do well?⏎I’d like to ask you another question. What is something you can’t do well?⏎<|endoftext|>Discover the cosmos! Each day a different image or photograph of our fascinating universe is

2. #2 peak

   highlights the extraordinary visual adaptations of miniature marine creatures.⏎CONTENT PROVIDED BY⏎Congdon, O. (n.d.). How is a mantis shrimp’s vision like<|endoftext|>Part 2 - Those Who Are Unable to See the Fact of Creation⏎The

3. #3 peak

   . Commonly referred to as the “love hormone,” oxytocin plays a major role in forming bonds and trust with others. Produced in abundance by breastfeeding mothers<|endoftext|>Every week in the art area of the classroom, your toddler will have the opportunity

4. #4 peak

   a blood vessel is also called a thrombus. A thrombus can stop blood flow to parts of the body. Thrombosis can cause the following:<|endoftext|>Cry, the beloved country contrasts the rural and urban ways of life. How

5. #5 peak

   called a hen. Juvenile turkeys are called poults. A group of turkeys is called a flock.⏎The benefits of raising white turkeys are<|endoftext|>In this thoroughly researched history, Graydon Meints tells the fascinating story of the

6. #6 peak

   35 PM EDT. …⏎What is the Flower Moon 2020?⏎The Next Full Moon is the<|endoftext|>“It’s tricky to rock a rhyme⏎to rock a rhyme that’s right on

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Geriatric Medicine study are available here: http://www.europeangeriaticmedicine.com/article/S1878-7649(13)00123-X/).⏎It is possible nursing staff underestimate the importance

2. #2 peak

   of diabetes and cardiovascular diseases, and conducting continuous surveillance to monitor the trends in NCD prevalence, their risk factors, and treatments.⏎Copyright © 2020 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved

3. #3 peak

   that the impact of religious education on Taiwanese students' civic values was low, with the main focus being personal and spiritual life development. Copyright © 2021 selection and editorial matter, Kerry J. Kennedy and John Chi-Kin Lee;

4. #4 peak

   by dredging activities, along with certain physico-chemical parameters of the water, were the major factors shaping phytoplankton communities.⏎- Abstract views: 1777⏎- PDF: 842⏎Copyright (c

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.