comma inside numbers and dates

What this neuron does

This neuron fires on the comma in written numbers and dates, such as the comma in 100,000 or in 'January 29, 2013'. Turning it up made the model's writing drift into strings of counting and repeated number-like text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   .S. trials before the Nuremberg Military Tribunals (NMT) took place from December 9, 1946 to April 13, 1949

2. #2 peak

   of the mother continent between 100,000 and 60,000<|endoftext|>Know Your Limits,

3. #3 peak

   anoma skin cancer) to estimate the number of people in the U.S. who had ever been diagnosed with cancer and who were alive on Jan. 1, 2007.⏎As of that day, 65% of

4. #4 peak

   potential investors and vie for prizes as large as $200,000 in value.⏎Helion Energy Fusion Engine has received about $7

5. #5 peak

   our commitment to continued energy efficiency gains, sustainability, and lower operating costs for consumers and enterprises.⏎The study further shows that an enterprise customer using 100,000 PCs running 6th Generation AMD A-Series APU could save

6. #6 peak

   required a great deal of structural analysis to ensure it can withstand seismic forces—and curious visitors.⏎January 29, 2013—It’s plain to see that turning the remains of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   CO2 soil concentrations are due to the volcanic rumblings of the magma still active below Mammoth Mountain. At more subtle levels this research has been able to map, using hyperspectral air borne imagery, the tree plant stress over all of the Mam

2. #2 peak

   a month later was life-changing for not just the Soviet Union and the US but for everyone on this planet,” Zelibor said. “It showed us all, we do not need to be bound by Earth’s gravity because we have an entire

3. #3 peak

   war:⏎“Think, too, of the great part that is played by the unpredictable in war,” Thucydides wrote, “and think of it now, before you are actually committed. The longer a war lasts, the more things tend

4. #4 peak

   the sacred isle of Columba! Here landing, he ascended the loftiest of the hills upon the isle, and "gazing into the distance, found no longer any trace

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.