mid-word fragments of long words

What this neuron does

This neuron tends to fire on a piece of a longer word that has been split up, such as 'Ful' in 'Fuligulinae' or 'ker' in 'handkerchief'. Turning it up did not produce an obvious theme; turning it down made the model repeat the word 'moments'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ustrades were ornately molded in pre-cast faux stone and lighting was generously provided from electric globes on eleborate cast-iron poles… large plinths marked the foot of the structure at both ends. The four rusticated pl

2. #2 peak

   Dictionary and Cyclopedia⏎- n. A sea-duck of the subfamily Fuligulinœ and genus Clangula; a garrot. The common golden

3. #3 peak

   54th Union Army regiment, the first all-volunteer black regiment. The sculpture, dedicated to black soldiers, is located in Boston

4. #4 peak

   ant that contains at least 70% alcohol.⏎- Other recommendations⏎- Avoid keeping your smartphone and handkerchief in the same pocket. Frequently wash your hands, especially when you are in

5. #5 peak

   early as February-April. Crops that need to be raised in warmth either indoors, in a greenhouse or under cloches e.g. tomatoes, peppers, courgettes are planted out after being ‘hardened-off’ (kept out during

6. #6 peak

   Platonis et Aristotelis / Comparison of Plato and Aristotle (1458). This book accused the humanist circle patronized by the Greek-born Platonist Cardinal Johannes Bessar

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   angles formed by the cords on the disk—the sum of the forces and the equilibrium conditions. Provenance: Lorraine collections.<|endoftext|>White sauce,

2. #2 peak

   and limitations cannot be understood only through electrical specifications and nameplate data, because redundancy is included in the design. In order to obtain a thorough understanding of electromagnetic force/torque generation, one must consider thermal characteristics

3. #3 peak

   of oil and sweat in the skin. It becomes scaly and even wounds and scars take more time to restore to health.⏎Repetitive facial expressions cause muscle contractions. As the elasticity of the skin diminishes,

4. #4 peak

   submaximal voluntary isometric contractions with the arm in a pronated position for ten healthy and young male subjects

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.