blank before or inside a number

What this neuron does

This neuron fires at the spot just before a number, such as the gap in 'population of 1.3 billion', or on digits in years like 2011. It seems tied to places where a figure is about to appear. Turning it up made the model drift into repeated phrases and unrelated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   assigns electoral-college votes to each country (including the United States), based on the size of its population. So, for example, China with its population of 1.3 billion people gets 1,900 electoral-college votes

2. #2 peak

   number of different Chinese “Dialects”, some which differ so much from each other that they may be referred to as “Languages”, for example Mandarin (about 850 million speakers) Cantonese (70 million). Other Major ones

3. #3 peak

   overall economic growth.”⏎The Bureau of Labor Statistics says startups created about 4.65 million new jobs annually from 1997 to 2000 compared to 2.5 million in

4. #4 peak

   demonstrated China's capability to conduct docking of a manned spacecraft with the experimental lab Tiangong 1 that China has had stationed in space since September 2011. Successful docking with an unmanned spacecraft had already been conducted in 20

5. #5 peak

   approved the manned spaceflight programme.⏎The country has steadily moved to accomplish this and in fact, the white paper on space activities issued by China in 2011 categorically identified the national ambition to "launch space laboratories, manned spaceship and

6. #6 peak

   over 3 million jobs being provided by the manufacturing industry, which employs 12 percent of the nation’s women and girls. That steady hum of progress

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   medicine⏎Knowing which genetic variants are responsible for differences in gene activity among individuals can give powerful clues for diagnosis, prognosis and intervention of different diseases. Senior author Emmanouil Dermitzakis, Louis Jeantet Professor at UNIGE

2. #2 peak

   al. The script needed to be altered to meet these changes.⏎The Cham now live in two groups: the Western Cham of Cambodia and the Eastern Cham (Phan Rang Cham) of Vietnam. For

3. #3 peak

   -entry of the unmanned Jules Verne ATV spaceship over the South Pacific.⏎"Jules Verne has now successfully completed its mission," ESA Director-General Jean-Jacques Dordain declared at the International Astronautical Congress in Glasgow, Scotland

4. #4 peak

   the implications of non-cultural international legislation such as the European Convention on Human Rights and its fourteen protocols and national laws such as the Freedom of Information Act 2000;⏎- seek advice as necessary to ensure that the institution does what is right

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.