'of' in national and founding phrases

What this neuron does

This neuron lights up on the word 'of' in fixed phrases about countries and founding moments, like 'Constitution of the United States' or 'the founding of the Republic'. When it was turned up, the model's writing drifted into repeating 'our' and 'our country', which fits the same national theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   British America, and second in the British Empire, behind London. During the American Revolution, Philadelphia played an instrumental role as a meeting place for the Founding Fathers of the United States, who signed the Declaration of Independence in 1776

2. #2 peak

   that the Constitution of India is dynamic in nature, with the ability to adapt itself to the changing needs of the nation. Democracy and Federalism are the essential features of the Constitution and part of its basic structure.⏎"The Governor is established as the dej

3. #3 peak

   evolves, including the family, religion, language, national identity, and yes, good old democracy.⏎Just think of the history of American democracy. At the founding of the Republic in the late 18th century most people could not vote and

4. #4 peak

   Rotunda for the Charters of Freedom, located on the upper level of the National Archives Museum, is the permanent home of the original Declaration of Independence, Constitution of the United States, and Bill of Rights.⏎Designed by architect John Russell Pope as

5. #5 peak

   finances. But this system actually describes how the three branches of government work together to ensure that no one person or group has all of the power.⏎When the Constitution of the United States

6. #6 peak

   restoring Mexico to a Republic.⏎May 1st: Labor Day, commemorates the union movement of the Mexican worker. Article 123 of the Constitution of 1917 gave workers the right to organize labor unions and to strike

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   birth from civil war⏎Mao Zedong proclaimed the founding of the People’s Republic from atop Beijing’s Gate of Heavenly Peace on 1 October 1949, at the tail end of a vicious civil war with the Nationalists

2. #2 peak

   foods or supplements.<|endoftext|>Bagdannen, a former Mennonite congregation near Tilsit, East Prussia (now Sovetsk, Kalingrad Oblast, Russia), also called "the scattered church of Prussian Lithuania

3. #3 peak

   the imagination Geographical⏎- Walta Evans "School Librarian"<|endoftext|>Wing Tsun or Wing Chun?⏎or Wing Chung or Wing Tjun or Ving Tzun…⏎Differences in pronunciation, difference is spelling Latin convention, and

4. #4 peak

   , absence of effective medicines, the need for fast and precise lab tests to identify those who have the disease.⏎How can we contribute?⏎Oxford is leading CRyPTIC—Comprehensive Resistance Prediction in Tuberculosis: an International Consortium— as

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.