'the' before 'way' in idioms

What this neuron does

It fires on the word 'the' when the phrase is likely to continue with 'way', as in 'paved the way' or 'along the way'. Turning it down made the model output the Chinese word for road or way over and over, which fits the same idea of a path.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   in his own practice, Zahoor-ul-Akhlaq absorbed the shocks and hurdles of artistic transition from modernism to contemporaneity in Pakistan. He paved the way for post-modern artists to develop their own vocabulary, drawing upon traditional sources

2. #2 peak

   help. In 2007, she was trained by Gore and others to present The Inconvenient Truth slideshow as a Climate Project Ambassador, and paved the way for more presenters (including me!) to be

3. #3 peak

   2017 Gender Inequality Index and Pakistan does not fare not much better, ranking at 133.⏎Here are three outstanding leaders who paved the way in Afghanistan and Pakistan and made huge strides toward gender equality by fighting for girls

4. #4 peak

   south for the winter, traveling as fast as thirty miles an hour for hundreds of miles on end. The trip is long, with savage weather and many predators along the way, but Tiny Bird is built for this epic journey and eventually arrives at its

5. #5 peak

   A friend who is upright is honest and sincere. He or she is transparent without a hint of flattery or fakeness. He will not lead you down the slippery road where there is a chance of you breaking the law and is sincerely caring

6. #6 peak

   storage on a magnetic disc by solving the problem at the atomic level. It has managed to fit a single bit of data on just 12 atoms, paving the way for 400TB hard

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , the dream of the popes to convert the main, political centre of Russian Orthodoxy to some form of union with Rome handed many tangible advantages to the grand dukes of the Kremlin, who cynically exploited this dream. In the name of

2. #2 peak

   ern part of the Korean peninsula 3. The state of Paekche, because of the continuous pression exerted upon it by Koguryŏ 高句麗 4

3. #3 peak

   and died 48 hours after birth.⏎Pig clones have popped up in the United States, the United Kingdom, Japan and other locations,<|endoftext|>Cleopatra, queen of Egypt and lover of Julius Caesar and Mark Antony, takes her

4. #4 peak

   .⏎Looking anew at history from this perspective forces a reconsideration of accepted notions from “Greco-Roman civilization,” the “European miracle,” and the “Great Divergence” to “Japan’s modernization.” Through

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.