end-of-document token and code keywords

What this neuron does

This neuron fires on the marker that separates one web page from the next, right where a new unrelated document starts. Turning it up made the model write code words like 'if', 'while' and 'else' over and over, so this is a mixed signal.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   wellandgood.com.<|endoftext|>The Technology Behind Bella Hadid’s Spray on Dress⏎During the 20

2. #2 peak

   locate.<|endoftext|>Science Fair Project Encyclopedia⏎The World Factbook⏎The World Factbook is an

3. #3 peak

   comment.<|endoftext|>100 Chemistry Questions and Answers 8211; Basic Chemistrynbsp

4. #4 peak

   ycetica<|endoftext|>Adding Fractions Level 3⏎The 5-step planIn Adding Fractions

5. #5 peak

   Project:<|endoftext|>After years of experience and "combing through" catalogs⏎to find the best

6. #6 peak

   _to_eat_gmos_so_why_are_we/<|endoftext|>A PhD can open a lot of job opportunities. Most of those jobs are academic

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   print "This might take a while..."⏎> 4 for i = 1 to n⏎> 5 for j = 1 to i⏎> 6 print

2. #2 peak

   and air conditioning systems, it also means that pollutants that originate indoors are getting trapped inside.⏎“People normally<|endoftext|>Spring Dawn by Meng Haoran 春眠不觉晓 处处闻啼茑 夜来风雨声 花落

3. #3 peak

   _arr = [1, 2, 3, 4, 5] i = len(given_arr) - 1 while(i >= 0): print(given_arr[i]) i = i - 1⏎In this program

4. #4 peak

   Matlab Basics II - Create a vector with a repeated entry⏎Create sequnce 1 4 9 16 25.........⏎Basics: Divide integers to get integer outputs in all cases⏎Determine value using Look-up

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.