'of' inside fixed noun phrases

What this neuron does

This neuron lights up on the word "of" in set phrases like "field of view", "cause of death" or "conflicts of interest", where the next word is fairly predictable. Turning it down made the model get stuck repeating "of the year of the year", so it seems to help keep phrases like this flowing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   time during a comets apparition even⏎binoculars will be too powerful...⏎A telescope is a big mistake, it will have much too narrow a field of view.⏎Please, you should not just go out to an unfamiliar rural "dark

2. #2 peak

   em examination, please contact the Social Worker at the State Coroner's Office.⏎In most coronial cases a post-mortem is required to determine the precise cause of death with certainty. However, on some occasions the Coroner can determine the cause

3. #3 peak

   way, Gao and his colleagues demonstrated that the tool could reveal signs of pulmonary fibrosis in COVID long-haulers, thus helping to account for shortness of breath, coughing and other lung troubles. A diagnosis, he suggests, that

4. #4 peak

   5i2.5⏎© 2018 Author. This work is licensed under the Creative Commons Attribution 4.0 International License.⏎Conflicts of Interest: None⏎Mild traumatic brain injury is defined as a traumatically

5. #5 peak

   the world? 70% of all PET bottles are recycled here, compared to 31% in the USA. But before you give yourself a pat on the back for this achievement, can you name the invisible force behind it? It

6. #6 peak

   actually delivering on the goal of limiting warming to 2°C. The authors drew on available data to establish global reserves at 1,294 billion barrels of oil, 192 trillion cubic metres of gas, 728

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   nests, but the Son of Man has no place to rest."⏎American Standard Version⏎And Jesus said unto him, The foxes have holes, and the birds of the heaven have nests; but the Son of man hath not where to lay his

2. #2 peak

   atuation for someone, especially someone inappropriate or unattainable. … Unlike crushes and states of infatuation, love truly sees and accepts their object of affection. Love is an intense feeling of deep affection

3. #3 peak

   about cartilage damage is a good place to start. There are times when cartilage damage is so significant that replacing the joint is necessary to help restore function and range of motion.⏎What Are the Primary Functions of Cartilage?⏎Cartilage plays a

4. #4 peak

   Holman Christian Standard BibleJesus told him, “Foxes have dens, and birds of the sky have nests, but the Son of Man has no place to lay His

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.