the digit 1 in powers of ten

What this neuron does

This neuron fires on the digit 1 when it starts a power of ten, as in 3 x 10^8 or 10^-11, and the positive side is about big or tiny numbers written in scientific notation. Turning it up made the model repeat number words like 'ten' and 'nine', which matches what it was tracking.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   = 0, and mℓ = 0 is where σ = r/a0 and a0 is the Bohr radius (5.29 × 10-11 m). Calculate the position of the nodes for this wave function

2. #2 peak

   substance of one density into a substance of different density, the speed of light changes and bending of light occurs.⏎In air, light travels at 3 x 108 m/sec but in water, it travels only about 2.2

3. #3 peak

   -Boltzmann formula:⏎E = εσT4⏎where ε=emissivity, a material property; σ = 5.67×10-8 ; T = temperature in Kelvin (absolute

4. #4 peak

   water than in air, water is said to have a greater optical density than air.⏎Substance Speed of light (m/sec)⏎Vacuum 3 x 108⏎Air 3 x 108⏎Water 2.

5. #5 peak

   small when written as 52!, but it can also be written in scientific notation as 8.065817517 × 10^67. If I attempt to write it using normal numerals,

6. #6 peak

   2.4 \times 100 \div 3.2$.⏎You could, of course,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   strains⏎Klebsiella resistant strains have been recorded in USA with a roughly threefold increase in Chicago cases, Brazil with 15 deaths per 163 cases, quarantined individuals in Israel, United Kingdom and parts

2. #2 peak

   a substance of one density into a substance of different density, the speed of light changes and bending of light occurs.⏎In air, light travels at 3 x 108 m/sec but in water, it travels only about 2.

3. #3 peak

   iate ligament (ACL) is the most commonly injured ligament of the knee. Every year, there are around 30 cases of ACL injuries for every 100,000 people. If the ACL is torn, surgery

4. #4 peak

   Re became Tefnut's father. According to one myth, Tefnut became angry with her father Re and ran off to Nubia. The god Thoth went to find her and conjoled her into returning to Egypt.⏎

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.