'the' before river names

What this neuron does

This neuron fires on the word 'the' when a river, or a body of water, is about to be named, such as 'join the Seine' or 'banks of the Mississippi'. It stays quiet on most other uses of 'the'. Turning it up gave odd text with no clear link to rivers.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   enters France northeast of Hirson, 9 miles (15 km) from its source, and flows generally southwestward, watering the Paris Basin, to join the Seine River at Conflans, after a course of 188

2. #2 peak

   ). It is also one of the “finest detours in France” network (Plus beaux détours de France). Stretching out along the banks of the River Ornain, it was, for many years, the capital of the

3. #3 peak

   field, was the birthplace of modern Manchester.⏎It was established by 78 AD at a site overlooking the confluence of the rivers Irwell and Medlock.⏎This was a timber fort with earthen ramp

4. #4 peak

   of Saint-Gobain, Compiègne, Hallatte, and Chantilly. Near Compiègne it receives its main tributary, the Aisne; and below the industrial town of Creil, it is joined

5. #5 peak

   en gravure kaart] Schenckenschans, 1635.⏎Plan of the fortification of Schenkenschans, located between the rivers Rhine and Waal, including details on the landscape. During the Eighty

6. #6 peak

   3, and 4 (teen team) will work between the remaining walls of a Roman villa on Poggio del Molino (Windmill Hill), overlooking the Mediterranean Sea. The villa was built at the start of the 1st century

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Magnet or Ferromagnetic Material. The Stepper Motors are manufactured with steps per revolution of 12, 24, 72, 144, 180, and 200, resulting in stepping

2. #2 peak

   that they were propelled primarily or entirely by sail. The length of the round ships ranged from 26 to 48 feet (8 to 14.7 meters), and they were between 8 and 16 feet (2

3. #3 peak

   of them 10,000 km (6200 miles) away, and one 18,000 km (11,100 miles) from the blast. These stations monitor seismic waves, infr

4. #4 peak

   said Lopez at the site, where the temperature reaches 45 C (113 F) at this time of year.⏎The first investigatory work was done

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.