blank before a number word

What this neuron does

This neuron fires on an empty gap just before a number, such as "for [ ]40 years" or "the last [ ]16 years", where the missing word is a count. Turning it up made the model write long strings of zeros and percentages.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   sound of the Antarctic break. Their work makes use of data gathered by University of Chicago glaciologist Douglas MacAyeal, who has studied Antarctic ice for 40 years. MacAyeal records seismographic data of glaciers to

2. #2 peak

   China had managed to sustain such high long-term growth and transformation. Frankly, I was stumped. I have spent over four decades in Asia, the last 16 years living in China, and no one had ever asked me that question

3. #3 peak

   grew up and his parents still own a ranch. They recently had to sell half their herd when their pasture couldn’t provide enough feed.⏎“They’ve spent the last 15 years grooming that herd for organic beef stock,” he said.⏎Bled

4. #4 peak

   tailor their research to meet the needs of field-based researchers and conservation practitioners.”⏎With funding from NASA to lead the study, Rose and his co-authors brought together 32 thought leaders from both the conservation and remote-sensing communities. The participants

5. #5 peak

   0 families as research partners to accelerate the scientific understanding of autism.⏎I’m a co-leader of the OHSU SPARK site, now one of just

6. #6 peak

   6 percent). Only one state, New Hampshire, had a poverty rate of less than ten percent for women, at 8.9 percent. In the other 47 states and the District of Columbia, between 10 and 2

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ⏎- other public and private sources.⏎The official seal of the CIA, however, may NOT be copied without permission as required by the CIA Act of 1949 (50 U.S.C. section 403m).

2. #2 peak

   the elderly. On the same day, the Consumer Financial Protection Bureau (CFPB) released a study reviewing financial education research priorities for America’s youth.⏎Congressmen Bill Foster (D-IL) and French Hill (R-AR) both introduced

3. #3 peak

   at the Capitol Hill exhibition, we’re coming across new questions as fast as we can answer the original ones. There’s a long way to go yet.⏎Senator Bill Nelson (D-FL), in his keynote address, highlighted the crucial importance of

4. #4 peak

   Pyongyang Times newspaper are on display. One reports on warming relations under North Korea’s late leader Kim Jong Il and U.S. President Bill Clinton during the 1990s. A more recent issue of the newspaper shows a photo of Trump

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.