"the" in "over the past" time spans

What this neuron does

This neuron fires on the word "the" when it comes right after "over" in phrases like "over the past decade". When it was turned up, the model got stuck repeating "last" and "past", which fits the kinds of words it helps predict next.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   . “The shellfish results indicate the strength of the growing aquaculture sector.”⏎Supply and demand of farmed oysters have risen exponentially in North Carolina over the past

2. #2 peak

   colonies are disappearing fast. According to the nonprofit organization Pollinator Partnership, the United States has lost over 50 percent of its managed honeybee colonies over the past 10 years.⏎Pollinator gardens are just one of the many ways

3. #3 peak

   date backwards, using B.C. dates, to the time of the creation of the world. Provisionally, based on the studies published in Biblical Chronology over the past two years, I have come to the year 3932 B

4. #4 peak

   by 50% before 2030.⏎This commitment isn’t just good for the planet—it also comes with considerable financial benefits. Numerous studies over the past three decades have proven the value of green building certifications, with a rental premium

5. #5 peak

   proximity to our brains, many people are worried that they might be associated with an increased risk of brain tumors. There have been around 30 research studies over the past decade that have looked at this issue and most have found that:⏎- People

6. #6 peak

   breakthrough research is Allan Showler, an entomologist in ARS’s Integrated Farming and Natural Resources Research Unit at Weslaco, Texas.⏎“Over the 116 years since the boll

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   and browse over 110,000 wildlife and science products⏎Multi-currency. Secure worldwide shipping⏎Wildlife, science and conservation since 1985<|endoftext|>A new study recently published showed that for women who are overweight

2. #2 peak

   solar winds. After decades of working on that theory, a 1999 study reported evidence that the Sun's magnetic field had strengthened greatly since the 1880s, which brought more attention to the question of whether increased solar

3. #3 peak

   problem is relevant for Professor Finnegan's class at WSU.⏎What textbook is this problem found in?⏎Our data indicates that this problem or a close variation was asked in Chemistry: An Atoms First Approach - Zumdahl Atoms 1

4. #4 peak

   .11i standard. WPA could be implemented through firmware upgrades on wireless network interface cards designed for WEP that began shipping as far back as 1999. However, since the changes required in the wireless access points (AP

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.