'1' in 21st or 11th, before 'st'

What this neuron does

This neuron fires on the digit '1' in ordinal numbers like '21st' or '11th', just before the 'st' ending. It is negative on the 'i' in 'fiftieth' and 'seventieth'. Turned up, the model produced long runs of 'st', which matches what it tends to predict next.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   . The first modern vacuum cleaner. The first aeroplane. The vacuum tube diode. Bakelite.⏎And what about the first decade of the 21st century? The list is long, and you may be surprised by some of

2. #2 peak

   put enormous strain on the planet’. The United States stood 17th in the rankings.⏎Meanwhile, among neighboring South Asian countries, India ranked 131st on ‘planetary pressures-adjusted’ HDI, Bangladesh, 1

3. #3 peak

   , Pelican ©2012, 978-1-4556-1637-4⏎In the 21st century, with GPS and vast improvements in diving equipment, many wrecks are

4. #4 peak

   nearby town of New Alexandria to learn the blacksmith trade before enlisting in the Union Army.⏎In 1861, William enlisted in the Pennsylvania 11th Reserve Infantry. He was just 18 and small in stature.

5. #5 peak

   indigenous to the area. Most states have<|endoftext|>A new smartphone app aims to provide a cheaper alternative to ultrasound in Africa by bringing an old technique into the 21st century.⏎"We couldn't hear anything,”

6. #6 peak

   human activities can theoretically exert some influence.(7) As the 21st century began, some experts thought it plausible that the Sun might have driven part

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   about the implications for the Geneva Refugee Convention on its seventieth anniversary.⏎The postwar refugee situation affected many people who had lost their homes

2. #2 peak

   of designing for resilience and is critical for climate change mitigation and adaptation.<|endoftext|>On July 20, 2019 we will celebrate the fiftieth anniversary of the Apollo 11 moon landing. People of my generation thought

3. #3 peak

   restaurant area dedicated to the exploits of these two intrepid airmen, was so named because it opened in 1969, on the fiftieth anniversary of the flight. Highly recommended for a visit by people, such as

4. #4 peak

   moon.⏎- Ashura: 10th Muharram*⏎Ashura is an Arabic word meaning “ten”. It is celebrated on the 10th day of the Hejrah-e qamari month Muharram

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.