repeated words and ellipsis dots

What this neuron does

It reacts to a word or punctuation mark that repeats or stutters, like 'very, very' or the dots in '. . .'. Turning it up did not produce a clear matching theme in the model's writing, and turning it down caused repetition.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   agreed to assume claims by citizens of the United States against Spain. In Article III, the treaty stated that: "The boundary line between the two countries. . . shall begin on the Gulph [sic] of Mexico, at the mouth of

2. #2 peak

   , 2003, the National⏎Transportation Safety Board (NTSB) made its boldest statement to date.⏎They stated that “ . . . the safe operation of fifteen-passenger⏎vans requires a knowledge and skill level

3. #3 peak

   some 44,000 generations, equivalent to some million years of generations of a human population (but the evolutionary opportunities for humans would be far, far less, due to the small population numbers limiting the number of mutational possibilities;

4. #4 peak

   is defined as to:⏎“engage in a course of vexatious conduct or to make a demand or a sexual solicitation or advance that one knows or ought reasonably to know is unwelcome.”⏎Severe Act or Pattern of Actions⏎Let’s

5. #5 peak

   ! How changed she was! How very, very different she looked from the last time she had seen herself in a big mirror!

6. #6 peak

   in another(),so this prints 20. Thus final answer is 10 0 20. I hope i have been clear enough. ------------------ Come on in !! Drinks are on the house in the Big Moose Saloon !

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   in business.⏎This week’s article by Jeremy Rosen on Rav Lichtenstein is available from http://jeremyrosen.blogspot.co.uk/2015/08/rav-lichtenstein-zl.html⏎Your comment will be posted

2. #2 peak

   the issue of Southern autonomy.⏎In 1924, the 28th president of the United States, Woodrow Wilson, died in Washington, D.C., at age 67.⏎In 1930, the

3. #3 peak

   NR in decibels. From Step 1, we have the decibel value LdB as LdB = 10 log10 (P1/P0). Now let P1 = MAX^2 and P0 = MSE.

4. #4 peak

   Pesticides in Produce⏎Researchers Highlight Pesticides in Produce,⏎Baby Food, Tap Water⏎Washington, D.C. – Environmental Working Group has released the eighth edition of its Shopper’s

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.