"which" after a noun of "the X of which"

What this neuron does

This neuron fires on the word "which" when it comes after a phrase like "the origin of" or "the building of", where it starts a relative clause. Turning it up made the text wander into repeated, unclear phrasing.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   as Āmū, Chāch, Xīwa, Samarqand, Chaghāniyān and some others, the origin of which till now remains unknown. Name of Buxārā, which is

2. #2 peak

   viruses cannot, in general, spread via Web site access.⏎Of course, the above remarks do not always apply. By relaxing the security settings (the details of which depend on both operating system and browser), it is possible to create an environment in

3. #3 peak

   . So, if you are relying on government, you are in fact relying on your fellow countrymen who work hard each day to earn an income the portion of which would be taken ‘without prior consent’ by the government which would in turn use

4. #4 peak

   their satellites.⏎In the face of these multiplying instances of treaty-breaking, of violence, and of open warfare, the United States followed a policy the successive stages of which are summed up here.⏎During the years preceding the outbreak of war in Europe in

5. #5 peak

   the long-awaited and often-troubled advent of the railroad in the state, the building of which shifted from private to public efforts and back again, amid tumultuous social, business

6. #6 peak

   supported by Tannen’s research and my personal observation and experience, is that there is a difference in communication style and objective between the genders – the understanding of which can aid our effective partnership in the kingdom. This difference in style is a reflection

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   in clinical settings (note, there are now phase II clinica trials of a small molecule activator of cardiac myosin for congestive heart failure;Malik et al., Cardiac Myosin Activation: A Potential Therapeutic Approach for

2. #2 peak

   66 million years ago - best-known for the extinction of the dinosaurs, the Cretaceous-Paleogene extinction event killed off three-quarters of all species. It's

3. #3 peak

   historic mammal hair discovered in Cretaceous amberJune 16th, 2010 - 1

4. #4 peak

   the journal Palaeontology.⏎The South Pyrenean area is rich in dinosaur egg sites, most of which communicate to sauropod eggs from the upper Cretaceous, dating back more than 70 million years ago.⏎During that period

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.