'of' in titles and place names

What this neuron does

This neuron lights up on the word 'of' when it links a job title or place to a name, as in 'Bishop of London' or 'City of Opelika'. Its opposite is the word 'from' after a noun, as in 'residues from'. Turning it up did not make the model's writing clearly about titles or places.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   could hardly be found to bury the dead, and many thousand bodies were carelessly thrown into mere pits dug in the open fields.⏎Ralph Stratford, Bishop of London, shocked at these unsanctified interments, in his zeal to

2. #2 peak

   1472, Niccolò Perotti (1430-1480), secretary to Cardinal Bessarion and archbishop of Siponto, donated to Sassoferrato, the city of his birth

3. #3 peak

   century.⏎The site lay waste for about 150 years but, in the mid-11th century, Robert, bishop of Coutances, undertook the rebuilding of the cathedral in the Romanesque or

4. #4 peak

   with the study of literature.<|endoftext|>The two Supreme Court cases, Jones v. City of Opelika 316 U.S. 584 (1

5. #5 peak

   C. (Image via Zach Montellaro on Flickr, CC BY-NC-SA 2.0)⏎The two Supreme Court cases, Jones v. City of Opelika 316 U.S. 584 (1

6. #6 peak

   10, 2011⏎At 3pm on the 10th June 1540 Thomas Cromwell, the Earl of Essex and Henry VIII’s right-hand man, was in the council chamber at Westminster

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   personally how these gardens evolved under their care. The walled garden at Parham was probably created in the 18th century and paths and brick walls survive from that period. It must always have been a productive garden, supplying food and flowers

2. #2 peak

   of cesium due to leakage from the Fukushima power plant, depending on origin. See: Arsenic, Methylmercury.⏎Shellfish may contain residues from chemicals that have filtered or run off into the water in which they inhabit. Consumers

3. #3 peak

   of the old Gold Hill Hotel where Nancy Melton became operator⏎One of the tombstones in the Gold Hill cemetery, Ephraim Mauney, was from Stanly County⏎After the death of John Sr., and Joseph Sr. ,

4. #4 peak

   distance, are the only remaining relics of this green cathedral.⏎More cemeteries, designed by John Bergmans,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.