'of' after geographic nouns

What this neuron does

This neuron lights up on the word 'of' when it follows a place or landmark, like 'shores of Hawaii', 'floor of the mouth', or 'west coast of Mexico'. It is quiet on most other text. Turning it up gave repetitive sentences that were not clearly about geography.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   of the massive convergence of marine litter known as the Great Pacific Garbage Patch. The easternmost concentration of trash is midway between the California coast and the eastern shores of Hawaii.⏎These

2. #2 peak

   the oral cavity is produced by the submandibular glands, even though they are much smaller than the .⏎The are a pair of glands located beneath the floor of the mouth anterior to the . The secretion produced is mainly in nature, however it

3. #3 peak

   churban helps us mourn its destruction. Tisha B’Av is the culmination, of course, of two national tragedies: the loss of the first Beis HaMikdash as well as the Second Beis HaMikdash.⏎To

4. #4 peak

   the worst. Learn more about Ninja Polymers in the infographic below, and share individual story sections by clicking on the embed icon in the upper right-hand corner of

5. #5 peak

   shall begin on the Gulph [sic] of Mexico, at the mouth of the river Sabine, in the sea, continuing north, along the western bank of that river, to the 32d degree of latitude; thence,

6. #6 peak

   way stretches 4,000 miles north-to-south and 1,000 miles east-to-west. From the Arctic to the west coast of Mexico and the Rocky Mountains to

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , fellow skeptic, and fellow blogger Jeff Medkeff discovered the asteroid in 2000. It was given the preliminary designation of 2000 WG11, and Jeff had the privilege of naming it, and the short

2. #2 peak

   For further information and to get help call the Poison Help Line at 1-800-222-1222.⏎Synonyms and

3. #3 peak

   010] Please see my latest post about setting an ad hoc network to share an internet connection.<|endoftext|>Encyclopedia of Southern Jewish Communities⏎History of Congregation B'nai Israel, Little Rock⏎B’nai Israel congregation was first organized

4. #4 peak

   're saving.⏎For More Information...⏎Phone: 1-888-STAR-YES (1-888-782-7937)⏎For more information on activities ongoing

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.