end-of-document token after a web snippet

What this neuron does

Fires weakly on the invisible marker that the model uses to show one web page or document has ended and another begins. Turning it up made the model produce hesitant, rambling "I mean" text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   dark brown (2).⏎- Length: 11 cm (2)⏎- 6 g (2)<|endoftext|>Causes of Cancer⏎Cancers can develop from a variety of sources and causes

2. #2 peak

   per minute|⏎|45 years||88-149 beats per minute||175 beats per minute|⏎|50 years||85<|endoftext|>A Brief Introduction

3. #3 peak

   : ||9781312744967 (DRM-EPUB)|⏎|Read Aloud: ||not allowed|<|endoftext|>In 1979, police in Pensacola, Florida, arrested

4. #4 peak

   .org/catalog/V_4E4EE3EAD24043E2BC0B972CD24B176C<|endoftext|>Rurik DynastyArticle Free Pass⏎Rurik Dynasty, princes of K

5. #5 peak

   2021⏎- Nepali Climbers Open New Trekking Route on Mt. Kilimanjaro - September 9, 2021<|endoftext|>In this VB.NET sample project, you will learn to create a simple dictionary.

6. #6 peak

   In The Moon"⏎- 'Star Trek: The Next Generation' - "Rascals"⏎- 'Warehouse 13' - "Time Will Tell"<|endoftext|>I question why "pres" was marked incorrect in this exercise. As I understand

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   J.M.; Mortimer, S.R.; Brereton, T.; Redhead, J.W.; Thomas, J.A.; Pywell, R.F.. 20

2. #2 peak

   different. Although the latest legs have exceeded all expectations in stress-testing–the 3-D-printed plastic is about as strong as a traditional prosthetic-–coons and associate professor Matt Ratto have yet to find the perfect thickness, the

3. #3 peak

   2.16.128.0/17 SUBNET3 : 10101100.00010001.0yyyyyyy.yyyyyyyy => 172.1

4. #4 peak

   /Share-Alike License⏎- n. An underwater explorer.⏎from WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.⏎- n. an underwater swimmer equipped with a face mask and foot fins

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.