comma inside large numbers

What this neuron does

This neuron fires on a comma sitting inside a big number, like the comma in "$157,000" or "6,000 lbs". Turning it up made the writing repetitive and looping, which does not show much about the comma itself.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Lubantuun in 1927.”⏎The Crystal Skull is often referred to as the “Skull of Doom”; the skull was made from a single, unusually large block of clear

2. #2 peak

   Curtiss and purchase a plane for $7,000 ($157,000 in today’s money). While waiting for it to be built,

3. #3 peak

   4 wheels required to carry a 6,000-lb load would use the following calculation:⏎[(4,000 lbs + 6,000 lbs) × 1.25] ÷ 4

4. #4 peak

   14 Star Tribune<|endoftext|>For practical purposes, the M1 Ultra acts like a single, impossibly large slice of silicon that does it all. Apple’s most powerful chip

5. #5 peak

   of effectiveness) each year produces over $350,000 more income for his/her students compared to an average teacher. On

6. #6 peak

   the commands you give and the M-file are somewhat disparate. The process is illustrated using a single, simple differential equation:⏎Integrate this equation from t = 0 to t =

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   into what the Framers found important in 1781, and what they changed their minds on by 1788.⏎They might have been onto something here:⏎Term limit for legislative office⏎Articles: No more than three out

2. #2 peak

   remote-controlled torpedoes and devices that had applications in missile defense and computers, long after his death in 1943.⏎Now the race is on to preserve Tesla's<|endoftext|>For years, the feeding habits and nutritional requirements of the b

3. #3 peak

   , is stranger: they became symbols.⏎There is a single species of palm native to the entire state of California, the California fan palm, which is a big one with what looks like a fuzzy beard of brown leaves underneath its green fronds.

4. #4 peak

   Fisher (pictured above) and his band of treasure hunters finally found the big one. ‘Nuestra Señora de Atocha’ was the largest and

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.