'the' after 'to' in fixed phrases

What this neuron does

This neuron responds to the word "the" when it comes right after "to", as in "to the point of", "to the west" or "burned to the ground". It is pushed the other way by some abbreviations and spelled-out terms. Turning it up made the text repeat "the" a lot without a clear meaning.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   (and ‘living’) foods, well, alive! In a world inundated by highly processed or Genetically Modified foods that use chemicals as preservatives, to the point where animals will not even consider what we eat to be edible (see note

2. #2 peak

   on paper. Never mind what words they actually wrote, whether they used printing or cursive is Everything.⏎It's pretty serious business in Japan as well, to the point where a Japanese teacher, without seeing the actual action of writing taking place,

3. #3 peak

   005, over 7,000 natural disasters worldwide had taken the lives of nearly 2 million people and produced economic losses of more than $1

4. #4 peak

   The two rims are separated by a distance of only a couple of kilometers. To the west is the bowl-shaped crater Schmidt, and farther to the north are Manners

5. #5 peak

   . history. The attack on the Greenwood section of Tulsa, home to a prosperous African American community in the segregated city, left over 35 blocks burned to the ground and over 10,000 people — most of them black

6. #6 peak

   discussion of issues of race in the 1960s through the use of science fiction is an excellent example of this sort of approach. Now, to the matter of policebots.⏎The policebots under consideration are

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   in nearly every single manufacturing sector.⏎The possibilities of including women in this field are limitless. More women are pursuing college degrees in the fields of STEM (Science, Technology, Engineering, and Math) than ever before. Common misconceptions

2. #2 peak

   D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | 0-

3. #3 peak

   amount of tolerable global emissions over a period of time -- has to be set roughly at 1,600 Gt CO2 eq (gigatonnes of carbon dioxide equivalent) between 1990 and 20

4. #4 peak

   ters, ditches, man-made channels, storm drains, etc.) that is also:⏎- Owned or operated by a public entity (which can include cities, townships, counties, military bases, hospitals, prison complexes,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.