"the" after certain verbs and prepositions

What this neuron does

This neuron fires on the word "the" in certain fixed spots, such as "like the" or "comes from the". Turning it up made the model repeat phrases about "the problem" or "the time".

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   blizzard shuts down the highway, Phil finds himself trapped in Punxsutawney. He wakes up the next day, only to discover that it's not the next day at all. It's Groundhog Day all over again.⏎via Wikimedia

2. #2 peak

   Diagnosis and Treatment Interventions for Racial and Ethnic Minorities<|endoftext|>Lily of the valley, or convallaria, is not a true lily like the Easter or Asiatic lily, but is still toxic to dogs, humans and

3. #3 peak

   be rejuvenated in any way.⏎Likewise, damage by harsh scratching cannot be reversed.⏎Scratched tiles will continue to perform<|endoftext|>The word biathlon comes from the Greek word meaning two contests. At the Winter Olympics it means joining two sports together

4. #4 peak

   ithridatic War. As a result, Pompey had annexed Syria as a new<|endoftext|>Our Earth is one among many heavenly bodies rotating around a star, the Sun, which gives us light and heat. They all form what we call our

5. #5 peak

   and the Israelite people. Curiously, it was the king of Egypt, and not God, or the Israelites themselves, who coined

6. #6 peak

   today."⏎It is a question that will resonate with millions living in quarantine today – as people wake up every morning wondering if the day ahead will be any different from the 24 hours they have just endured.⏎But I have a more positive spin

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Missouri in 2015. They are the same facilities as in 2013, except that the Montrose Generating Station has dropped out of the top 10, and the Mississippi Lime Company

2. #2 peak

   as heart disease.⏎This study looked only at women diagnosed with breast cancer early – known as stages one or two. It did not include patients with advanced forms of the illness.⏎Experts believe radiotherapy may be far more effective at killing all cancerous

3. #3 peak

   – is rooted in a dispute over land claimed by Jews as their biblical birthright and by the Palestinians, who seek self-determination. Despite repeated attempts to end the conflict between the two countries, there is no peace settlement in sight. The issue

4. #4 peak

   for you. Thank You.⏎When I first entered the spoken word and writing community in the mid-1990s, one of the biggest names in the Southern California scene was Michele Serros. The Oxnard-born Serros great

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.