'the' before a noun after 'of'

What this neuron does

This neuron fires on the word 'the' when it comes right after a preposition like 'of' or 'to', just before a noun, as in 'the back of the book' or 'the stem of the plant'. Its negative side is weak and not clearly related. Turning it up gave text that did not clearly show this pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   for goods or services in some instances.⏎What are the different types of crypto on the market?⏎To put it simply, there are literally thousands of different cryptocurrencies on the

2. #2 peak

   adults focus on the value of being in the class and helping the class become a successful place of learning.⏎The instructor presented a survey to the students on the first day about the merit of participation; and, how participation can

3. #3 peak

   behind enemy lines for much longer than this and by 15 November all members of 1st Para Bn's detachment and most of 2nd Para Bn's detachment were unaccounted for.⏎The mission was extremely hazardous for the

4. #4 peak

   of symmetry as well).⏎: A parabola is the set of all points in a plane that are equidistant from the focus and the directrix of the parabola. [Adopted from iCoachMath]⏎Focus:Focus

5. #5 peak

   organized to allow easier administration of the tests in the classroom. Each test has a total score of 100.⏎An optional listening exercise at the back of the book for each unit, using the recordings from the Student’s Book.⏎An Answer

6. #6 peak

   by the plague bacillus, ingests bacilli which may multiply to such an extent that they completely block a valve-like organ at the entrance to the stomach of the flea. When such a flea deserts the host rat and transfers to a human

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   outnumber the colonists. New England, New York, Virginia, and South Carolina were scenes of numerous wars in the 17th century. In 1622, Indians killed a third of the one thousand settlers in Virginia. Another

2. #2 peak

   a (in male striped seals) or from the esophagus (in male walruses) and serve to alter the specific gravity of the body; and (4) in the sperm whale, a blind air sac about 1 cu m

3. #3 peak

   realish, 15. James Grealish (Michl), 16. John Carr (Pat), 17. Michael Sheridan, 18. Peter Grealish

4. #4 peak

   1989, it was among the first 25 featured films to be preserved in the Library of Congress’ National Film Registry, and in 2008, the American Film Institute named it the greatest animated film of all time

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.