last digits of big numbers

What this neuron does

This neuron reacts to the digits inside large numbers, like the final part of '24,300 mph' or '70,000 kilometres'. It does not change the model's writing in any obvious way when turned up.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Telescope on the space rock as it zoomed away from Earth at 24,300 mph on Wednesday. Swift is best-known for its observations of high-energy outbur

2. #2 peak

   Mars in several slingshot maneuvers to accelerate and help hurdle the spacecraft toward its destination. The comet is traveling toward the sun at 34,175 mph. After a high-speed chase across nearly 4 billion miles (6.

3. #3 peak

   ospheric Multiscale mission (MMS) has set the Guinness World Record for highest altitude fix of a GPS signal – at 70,000 kilometres above the surface of the Earth.⏎Operating in a highly elliptical orbit around

4. #4 peak

   Mars' distant past, according two new reports in the journal Nature.⏎Glaciers moved from the poles to the tropics 350,000 to 4 million years ago, depositing massive amounts of ice at the base

5. #5 peak

   so-called transition zone (top) and the core-mantle boundary (below). Pressures in the lower mantle start at 237,000

6. #6 peak

   above the convergent plate margin between the African Plate and the Eurasian Plate. It is the tallest active volcano in Europe, currently standing 3,329 m (10,922 ft) high, though this varies with

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   all counterfeit drugs contain the wrong ingredients, while 17 per cent contain the wrong levels of necessary ingredients.⏎High profits, low penalties⏎With nearly $1 trillion in<|endoftext|>|Scientific Name:||Pyrrhura viridicata

2. #2 peak

   in Chicago was called upon to assemble some detailed cost figures from butter manufacturers whose 77 plants produced almost 150,000,000 pounds of butter annually. These figures reflected accurately the big increases in the costs of

3. #3 peak

   05, over 7,000 natural disasters worldwide had taken the lives of nearly 2 million people and produced economic losses of more than $1 trillion. But the agency pointed out that efforts to better deal with disasters have begun to

4. #4 peak

   forced to pay billions in bribes annually to numerous regulatory and police stops on its interstate highways.⏎Indian media has widely published allegations of corrupt Indian citizens stashing trillions of dollars in Swiss banks. Swiss authorities, however, deny these allegations.⏎The

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.