'of' after a noun phrase, as in 'of course'

What this neuron does

This neuron responds to the word 'of' when it follows a noun and sets up a phrase like 'of course', 'each of which', or 'one of each'. Turning it up or down did not produce a clear theme in the model's writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   at AATR to help us through cycling in the wind either on solo or small group rides.⏎Plan your route!⏎If you’re heading out for a ride of reasonable length, check the weather forecast and wind direction for the duration of the ride

2. #2 peak

   has a population of 4,008,994. Popular nicknames for Philadelphia are Philly and The City of Brotherly Love, the latter of which comes

3. #3 peak

   across disparate operating systems.⏎Kubernetes clusters are actually a set of nodes categorized into master nodes and worker nodes. Every cluster needs to have at least one of each. While the master node is meant to control the state of a cluster,

4. #4 peak

   ating a gas balloon similar to the ones used by Lowe, and allowing visitors to interact with Lincoln, Lowe and Mary Henry themselves (portrayed by actors, of course). There will also be presentations about ballooning and espionage during the war,

5. #5 peak

   of materials and weight and requires something that is much harder to come by: a propellant. You can make your own gunpowder, of course, but refining the process to create effective munitions is as tricky as building

6. #6 peak

   9 determined that enslaved people in the state would be emancipated on July 4, 1827, but there were addenda and provisos, of course, so not everyone was instantly manumitted on the magic date, and

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   why it is so significant that the angels described Jesus’ birth as “peace on earth.”⏎9 And an angel of the Lord appeared to them, and the glory of the Lord shone around them, and they were filled with great fear.

2. #2 peak

   3,4 The voice of the LORD is upon the waters; The God of glory thunders, The LORD is over many waters. The voice of the LORD

3. #3 peak

   content make, and they explicitly disclaim, any express or implied representations or warranties of any kind, including, without limitation, representations and warranties as to the functionality of the translation feature or the accuracy or completeness of the translations.⏎Translations are not retained

4. #4 peak

   irling wheels⏎Four strange whirling wheels are associated with the cherubim.⏎Then I looked, and behold, in the expanse that was over the heads of the cherubim something like a sapphire stone, in appearance in the likeness

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.