'both X and Y' pairing words

What this neuron does

This neuron responds to words in sentences like 'both ... and', 'both excited and terrified', or 'between 1910 and 1930' where two things are being paired. It is weaker on the number sections of date ranges. When it was turned up, the model produced loose, unfocused text, and turning it down made it repeat 'and'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   by adding English to Urdu translations, Urdu to Roman Urdu transliterations and Urdu to English Translations. This will improve our English to Urdu Dictionary, Urdu to English dictionary, English to Urdu Idioms translation and Urdu to English Idioms translations. Although

2. #2 peak

   determined to continue flying. Arthur Whitten Brown, born 1886, was, after WW1 determined to develop his navigational skills. Both Alcock and Brown were dedicated to becoming highly proficient aviators.⏎In April 19

3. #3 peak

   programs from around the world — a vision of worldwide broadcasts from an age when TV was little more than an experimental toy for the rich.⏎But designs like these both excited and terrified people in the radio industry. By 1935, people

4. #4 peak

   “To combat global warming, we’re understandably going to make our buildings more sustainable. But in that process, we need to think of sustainability as both reducing energy demand and protecting the health of the building occupants.”⏎Waring’s academic background is as

5. #5 peak

   as well as quality protein, whole grains and low-fat dairy products or affordable plant milks. Regular, physical activity (both weight-bearing for musculoskeletal health benefits and intensive for cardiovascular health benefits) would be part of normal life. Maybe this

6. #6 peak

   soil moist all the way through. It also controls the growth of weeds. Mulch, therefore, fulfils the dual purpose of keeping the weeds away as well as providing nutrients to the soil.⏎But what exactly is mulch?

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   relief. The promise of jobs in northern factories during World War I provided African Americans an opportunity to escape the harsh realities of the South. Between 1910 and 1930, approximately 1.6 million African Americans left

2. #2 peak

   world.1⏎A 2007 report by the World Bank called attention to the rapid gains made by MENA countries:⏎Between 1980 and 2010, the average years of schooling for females aged

3. #3 peak

   470,000 people—or 21 percent of the island’s total population—left Puerto Rico for the United States between 1950 and 1960.⏎In what ways did the counterculture represent

4. #4 peak

   leaders also knew how to obtain it. They were themselves usually soldiers, and knew how to organize large, complex ventures along military lines. Between 1660 and 1727, 87% of the colonial governors were

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.