large number scale words

What this neuron does

This neuron responds to big number words like 'billion', 'trillion' and 'bn' that come right after a figure. When it was turned up, the model wrote out large numbers and population counts.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   orbiting satellites collecting solar energy and blasting it down to receiving stations in high powered laser beams. Safe free energy forever .... all we need are a few hundred thousand billions to set it up.<|endoftext|>Built on our successful pilot work in two Bay Area

2. #2 peak

   internet becomes integrated into virtually every aspect of life, keeping its infrastructure secure will be ever more essential. Spending on cybersecurity globally is expected to surpass $200bn in 2

3. #3 peak

   The development of hydraulic fracturing (‘fracking’) has raised US gas production dramatically, and helped double the estimated global gas resource to around 800 trillion cubic meters (tcm), or 250 years’ consumption at current

4. #4 peak

   of processors. The country had crossed the petaflop computer range and needs exascale computers, which are machines capable of performing 1000 trillion operations a second."⏎IIT Delhi will provide the infrastructure for the Exascale

5. #5 peak

   in about a cup of DNA.⏎There is a lot of digital information in the world about three zettabytes' worth (that's 3000 billion billion bytes) and the constant influx of new digital content poses a real challenge for

6. #6 peak

   the power system by 2030, as much as 15 trillion litres of water could be saved. That's the equivalent to the annual consumption of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   of the neuron network of a human brain, with ultra-high resolution and in three dimensions. The coalition now grows to a network involves over 1,000 researchers from Singapore, Australia, China, Japan, Korea and Taiwan. The team

2. #2 peak

   as "the Monster" to the scientists who conjured it – to explore the mysterious subatomic realm. Fifty years later, more than 1,000 people gathered at SLAC National Accelerator Laboratory on Friday and Saturday to celebrate the

3. #3 peak

   dust generation inside pebble-bed reactors.⏎MELCOR is a fully integrated, engineering-level computer code that models the progression of severe accidents in light water reactor nuclear power plants. MELCOR is being developed at Sandia National Laboratories (

4. #4 peak

   023/B:BIOC.0000048451.07820.9c⏎- 1.1k Downloads⏎Recent massive imports of slider turtles, (Trachemys scripta

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.