'the' or 'of' after a role or title

What this neuron does

This neuron lights up on the small word 'the' (or 'of') right after a phrase that sets up a job, title or role, like 'is the Messenger', 'known as the' or 'Minister of'. Turning it up made the model's text drift into unrelated topics and repeat itself, so the effect on the writing was messy.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   them as false gods.⏎The second part of this declaration is that we believe that the Holy Prophet Muhammad, may peace and blessings of Allah be upon him, is the Messenger of Allah. Since he has come for the final, universal religion of Islam

2. #2 peak

   .D. 697-707, and was one of the great poets of the early days of Japan; he is known as the rival of Akahito Yamabe (see next verse), and after death was

3. #3 peak

   did reach Istanbul in 1918, Russia had made a separate peace with Germany and declared itself the enemy of all bourgeois states, France and Britain prominent among them.⏎What made you

4. #4 peak

   great struggle, we got freedom on 15th August 1947. He played a vital role in our independence, so we called him as the father of the nation. All our Indians with great love and affection called him as

5. #5 peak

   came to India in 1917 after acquiring a high degree of doctorate in economics from Britain.⏎According to his agreement, he worked as the Minister of Finance in the princely state of Baroda for some time. But he did

6. #6 peak

   greater now than it was before that Revolution which sought to bring about Islamist rule across the Arab world with the Shia Ayatollah Khomeini attempting to act as the leader of worldwide Islam. Khomeini hoped that Shi'ites in Iraq would

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , that all men are created equal, that they are endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the pursuit of Happiness.⏎Locke didn’t stop there, however

2. #2 peak

   , that all Men are created equal, that they are endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the pursuit of Happiness." Government's place in our lives is to provide us the basic God given

3. #3 peak

   the interplay of human emotions, thoughts, and actions by taking mythological metaphors. Kamayani has personalities like Manu, Ida and Śraddhā who are found in the Vedas. The great deluge described in

4. #4 peak

   could have been avoided⏎Jefferson tried to explain as best he can the philosophical principles of the war and of the DOI⏎life, liberty, and the pursuit of happiness⏎what Jefferson said that every human being had

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.