digits inside years like 19xx

What this neuron does

This neuron lights up on the digits inside years, especially the 9 in dates like 1997 or 1909. It goes strongly negative on large round numbers and ancient dates such as 15000 BC or 10,000 years ago. Turning it up made the model's text drift into unrelated rambling about the weather, the news and everyday topics.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   or Arcturus – nearer than ten parsecs1 and only about four main sequence A stars.⏎– Dutch astronomer Willem Jacob Luyten (1899 - 1994)⏎The closest star to us is,

2. #2 peak

   and not by birth. The nobleman is a righteous individual, an example of filial piety, humane behaviour, virtue and propriety (Ren 1997, pp. 19-20; Lee Dian Rain

3. #3 peak

   . On<|endoftext|>Anatoly Lunacharsky On Literature and Art 1909⏎The greatest of all great heroes of action was the Greek Hercules,

4. #4 peak

   supposed, that this name originated from the Sanskrit word vihara, that means "a Buddhist monastery" [Frye, 1956, p. 106 – 119]. However

5. #5 peak

   00 km2, within which as little as 200 km2 of primary forest may remain (T. Arndt in litt. 1993). Until recently it was judged to be fairly common (Ridg

6. #6 peak

   not overly large. The whitish-blue patches are distributed much as in Marcus's drawing of E. canguzua.⏎• Marcus, Er. (1955) Opisthobranchia from Brazil. Boletim

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   The history of art can be traced back to cave paintings of about 15000 BC. Gotell, E., Brown, S.,

2. #2 peak

   aceae family. Here are some Butternut Squash Health Benefits.⏎Squash is among the oldest known crops dating back 10,000 years to Mexico and America. The name squash, which means uncooked or eaten

3. #3 peak

   acious analytical framework that focuses on all textual records throughout human history, from the earliest periods of traceable communication—perhaps as early as 60,000 BCE—to the present day. At its core, it examines the material history of

4. #4 peak

   A Paleo diet is a diet plan based on foods similar to what might have been eaten during the Paleolithic era, which dates back from about 2.5 million to 10,000 years ago.⏎Food used to be obtained

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.