"of" inside titles and names

What this neuron does

This neuron lights up on the word "of" when it sits inside a title or a fixed name, like "The Diary of Anne Frank" or "Music of the Spheres". When it was turned up, the model's writing drifted into rambling, repeated phrases.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   the report. "The estimate is transparent and conservative," says particle physicist Georg Weiglein at the University of Durham, UK. "I ...<|endoftext|>The Diary of Anne Frank Essay written by l

2. #2 peak

   in American History: Selected Documents Celebrating the Manuscript Division’s First 100 Years features drafts of Langston Hughes’ poem, “The Ballad of Booker T.” In this 1941 poem,<|endoftext|>Whenever the st

3. #3 peak

   in her lifetime, a towering legacy left behind. Rest in peace, brave comrade,” she penned.⏎Former Chair of the<|endoftext|>The Kalima or the Declaration of Faith is two short sentences and is the essence of Islam. It is given below

4. #4 peak

   5:13-16 (The Prayer of Faith)⏎Have the kids find James 5:13-16 in

5. #5 peak

   equal to the sum of the squares of the sides containing the right angle." But Pythagoras had an all-inclusive vision, which also included the "music of the spheres" (the sound that no doubt had to be produced by the planets

6. #6 peak

   the 13th USENIX Security Symposium, 2004.⏎Garfinkel, S. and Shelat, A., "Remembrance of Data Passed: A Study of Disk Sanitization Practices," IEEE Security and Privacy

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   the speeds of two satellites placed in stable circular orbits of radius R and 2R respectively?⏎C) 1 / 2⏎D

2. #2 peak

   's own Apple II.⏎Jobs' vision of "good design" meant not only building aesthetically pleasing machines, but devices that had a utility of function like user-friendly GUIs akin to those seen on early Macs.⏎Near

3. #3 peak

   Like⏎their giant counterparts, Humboldt squid are enigmatic. No one has⏎seen them mate or lay eggs. No one has watched them develop from⏎egg to adult. No one knows how many exist.⏎These tentacled titans

4. #4 peak

   of the Journal of the American Academy of Religion eschews this empirical approach. Twelve scholars of Hinduism three of them practicing Hindus attempt to answer this question by methodical analysis. None can be said to successfully respond to the question, but their

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.