'of' inside fixed noun phrases

What this neuron does

This neuron fires on the word 'of' inside set phrases, most often medical symptoms like 'shortness of breath' or 'loss of appetite', and also 'sleight of hand'. Turning it up did not produce a clear change in the model's writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   vessels cause a decrease in the symptoms of congestive heart failure, including shortness of breath, fatigue, and swelling, and can help improve tolerance for exercise.⏎When

2. #2 peak

   - Trouble concentrating⏎- Joint pain and stiffness⏎- Muscle cramps⏎- Impaired memory⏎- Can’t find the right words⏎- Shortness of Breath⏎- Metallic taste⏎- Watery eyes⏎- Sensitivity to light

3. #3 peak

   way, Gao and his colleagues demonstrated that the tool could reveal signs of pulmonary fibrosis in COVID long-haulers, thus helping to account for shortness of breath, coughing and other lung troubles. A diagnosis, he suggests, that

4. #4 peak

   of the most crusading anti-spiritualists of the 1920s. Because of his familiarity with the illusions of stage magic and sleight of hand, Houdini was particularly adept at spotting the trickery that the so

5. #5 peak

   dramatic swings . . . the Chesapeake Bay had one of the hottest years,” he added.⏎Mike Armstrong, a fisheries biologist and assistant director of the Massachusetts Division of Marine Fisheries, underscored the significance of the striped bass fishery. “It

6. #6 peak

   150 beats/min in patients not taking atrioventricular (AV) nodal blockers. It can lead to symptoms of palpitations, shortness of breath, fatigue, or lightheadedness, as well as an increased

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   glue the printed pages to cardboard (like old cereal boxes) and then cut out the cards and boards.⏎The Rules: To play, you need to print out the deck of picture cards and at least one board for each player. Each player

2. #2 peak

   kidney disease. Nevertheless, the rate of kidney trouble was about 20 percent higher among people who had received high-dose NSAIDs than among those who had taken none. The absolute risk of acute kidney injury was 3 in 1,

3. #3 peak

   20 temperature sensor that didn’t require a battery or constant source of wired electricity. 3D printing isn't new either, and already, researchers can print out human organs using biological "ink".⏎The UW team are, however, the first

4. #4 peak

   since "anno mundi" is Latin, it is technically more correct to write A.M. 1656, just as it is more correct to write A.D. 1991 than to write 1991

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.