unclear: word pieces inside names and words

What this neuron does

This neuron reacts to a fragment in the middle of a longer name or word, like the 'of' in Sassoferrato or the 'Be' in Beethoven. Turning it up made the model's writing drift into repeated or off-topic text, so it doesn't clearly control anything we could name.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   and their visitors came from all walks of life and practiced asceticism with varying degrees of rigor. Certainly, an elite background did not preclude a monastic vocation

2. #2 peak

   ò Perotti (1430-1480), secretary to Cardinal Bessarion and archbishop of Siponto, donated to Sassoferrato, the city of his birth, a collection of reliquaries,

3. #3 peak

   Based on stylistic analysis, according to Martin Donnert, the mosaic icon at Sassoferrato was executed in the 14th century as a typical work of

4. #4 peak

   symphony based on the life of the English military-imperial hero General Gordon, which, fortunately, did not get far.⏎Any composer approaching the symphony after Beethoven might well have had some trepidation about it. Brahms’ difficulties

5. #5 peak

   Institute of Medical Sciences, Ansari Nagar, New Delhi 110029⏎|How to cite this article:|⏎Krishnan A, Behera P, Nongkyn

6. #6 peak

   ’s nocturnes, Bach’s preludes and fugues, and the works of Clementi, Mozart and Beethoven. But Elsner also recognized Chopin’s unique talents and encouraged the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Soyuz 17, Salyut 6 EO-1, Salyut 7 EP-5. More...⏎Makarov Makarov, Oleg Grigoryevich (1933-20

2. #2 peak

   the Rurik princes maintained their control over Kievan Rus and, later, Muscovy until 1598.⏎Rurik’s successor Oleg (d. 912) conquered Kiev (c. 8

3. #3 peak

   pioneer and wealthy Chicago sportsman Logan “Jack” Vilas made the initial flight in order to demonstrate the viability of using aircraft in fire prevention. Wisconsin’s Chief Forester Edward Griffith hired him but Vilas refused pay, saying that he wanted only

4. #4 peak

   was crowned as the first king of Jerusalem on Christmas Day, 1100, by Dagobert of Pisa, the Patriarch, who would have preferred to turn the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.