'the' after a verb or preposition

What this neuron does

This neuron fires on the word "the" when it comes right after a verb or preposition, such as "follow the", "within the" or "maintain the". Turning it up gave text that did not stay on one topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Romanisation of Chinese⏎Romanisation (or latinication) refers to the written representation of a Chinese word by using the Latin (Roman) alphabet.⏎To appreciate the reasons for variances in the romanised spelling of Chinese words one has to

2. #2 peak

   splints due to excessive muscle tightness or other factors. To avoid this problem, follow the “10% rule”: increase mileage no more than a 10%

3. #3 peak

   of 2016, and it's very satisfying to have come so far in the process that the plans will become reality. It's interesting to follow the customer in this exciting project, and we will do everything in our power to earn

4. #4 peak

   Transmission, Distribution, & Refining⏎Multispectral and Hyperspectral Remote Sensing Techniques for Natural Gas Transmission Infrastructure Systems⏎The goal is to help maintain the nation's natural gas transmission infrastructure through the timely and effective detection of natural gas leaks

5. #5 peak

   concept of cell organization in response to these morphogen gradients is well documented, little is known about how these subtle concentration changes get established the first place, particularly within the dynamic environment of a real tissue. This research provides evidence that tiny biophysical forces

6. #6 peak

   soil slides and/or gullying which primarily affect roads themselves, wiping them out and blocking vehicle circulation, and secondly, destroying or burying agriculture lands. Along the 138 km surveyed, we calculated an amount of soil material released of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   of the world's oldest, and largest monotheistic religions. These religions share a variety of customs, beliefs, and even practices

2. #2 peak

   their forms in the monotheism.⏎The UNITY and ONENESS is a general topic of conversation everywhere and

3. #3 peak

   six centuries before Christ. The Greeks and the Romans, meanwhile, gave the power of flight to their gods and to the mischief-making followers of those gods.⏎Polytheistic or non-literate cultures very often contain a belief 1n winged

4. #4 peak

   the kind created to soothe the terrors of the monotheists were less necessary. The Romanian gypsy, half Christian, half pagan prayed

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.