the gap before a year or number

What this neuron does

This neuron fires on the empty space that comes right before a year or number, such as the gap in "original 13 colonies" or "in 1776". Turning it down made the model loop on the word "school", and turning it up gave unrelated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   United States in 1777. Our nation's first official flag had 13 stars and 13 red and white stripes to represent the original 13 colonies that broke from British rule. The stars were arranged on a blue

2. #2 peak

   1776 will find there is no getting around the special role New Jersey played in reigniting the American Revolution.⏎As one of the original 13 colonies, N.J. responded forcefully to the phrase "no taxation without

3. #3 peak

   the case may be).⏎The United States has operated under two constitutions. The first, The Articles of Confederation, was in effect from March 1, 1781, when Maryland ratified it. The second, The Constitution,

4. #4 peak

   Security (DHS)’s Customs and Border Protection apprehended 101,952 unaccompanied children (aliens under the age of 18 who either came to the United States without authorization or overstayed their visa

5. #5 peak

   history, the U.S. Civil War, was resolved by amendments—creating the legal foundation for the equal rights of African Americans. The 13th, 14th and 15h Amendments—collectively known as the Civil

6. #6 peak

   than 70 years for women to receive the right to vote, a goal that finally was achieved when the Nineteenth Amendment passed in 1920. Three years later, at the 75th anniversary

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   for multiplication.⏎When should kids memorize times tables? When their love for multiplication is strong enough.<|endoftext|>What Is Sufism?⏎Sufism, mystical Islamic belief and practice in which Muslims seek to find the truth of divine love and knowledge

2. #2 peak

   Taoism is the belief in balancing forces, or yin and yang.⏎Where is Taoism mostly practiced?⏎Today, Taoism is recognized as one of the great world religions and continues to be practiced by people in China and throughout the world.⏎

3. #3 peak

   Islamic parties - most prominently the Barelvi school of Islam.⏎Pakistan's laws became particularly severe between 1980 and

4. #4 peak

   practice within the ambit of Shia Islam during the late medieval period. Although Sufis were opposed to dry legalism, they strictly observed Islamic law and belonged to various schools of Islamic jurisprudence and theology.⏎Sufis have been characterized by

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.