the piece 'Mont' in place names

What this neuron does

This neuron fires on the start 'Mont' of place names such as Montenegro, Montpellier and Montevideo. Turning it up made the model repeat 'a little a little', which has no clear link to the place names.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Egypt, El Salvador, Finland, Grenada, Guatemala, Japan, Lao, PDR, Macedonia, former Yugoslav Republic of, Mongolia, Montenegro, New Zealand, Nicaragua, Nigeria, Norway, Pakistan, Paraguay,

2. #2 peak

   16. A year later, the French settled in the area just north of present Montogmery and built Fort Toulouse on the river.⏎The Coushatta

3. #3 peak

   istinguished Service Cross, the Croix de Guerre with palms, the French Legion of Honor, the Croce di Guerra of Italy, the War Medal of Montenegro, and ultimately, the Congressional Medal of Honor in March of 19

4. #4 peak

   of yellowfin tuna (Thunnus albacares) in nearshore areas in French Polynesia, determined using ultrasonic telemetry⏎Centre IRD de Montpellier, BP 5045, 34032 Mont

5. #5 peak

   Republic’s School of Agronomy through an agreement with the government of the province of Montevideo and the Primary Education Board.⏎The programme provides the opportunity for direct contact

6. #6 peak

   was born in Montpelier, Vermont, on December 26, 1837

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   natural enemies that help suppress pest densities."⏎The study, "Multi-State Trials of Bt Sweet Corn Varieties for Control of the Corn Earworm (Lepidoptera: Noctuidae)," analyzed the performance of Bt sweet corn

2. #2 peak

   of events. Fate defines events as ordered or "inevitable" and unavoidable. Classical and European mythology features three goddesses dispensing fate, known as Moirai in Greek mythology, as Parcae in Roman mythology, and as

3. #3 peak

   prominent Creole family, the Puente de Ayala was opened to traffic in 1880. It connected the San Miguel district to Malate and Ermita.⏎The bridge also served Isla de Convalescencia, the

4. #4 peak

   leshana tova (happy New Year), to send greeting cards, and perhaps plant trees in Israel in their honor.⏎Although the high holidays lack the merriment of Purim, the gift giving of Hanukkah, and the joy

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.