unclear: word-start fragments like 'pl' and 'bl'

What this neuron does

It fires on the first piece of a word that has been split into smaller chunks, especially chunks beginning with 'pl' or 'bl' such as 'ploughs', 'plinths' and 'blisters'. The pattern is not very clean, and turning it up mostly made the model's writing collapse into odd repeated words.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ’s not expecting food. For this reason, endurance runners frequently consume mushy, easily digestible sources of fuel packed with carbohydrates. These include gel packs, gel chews, jellybeans made specifically for endurance athletes, baby-food pureed fruit packs

2. #2 peak

   Fossils⏎The coelacanth is a large fish some 1.5 meters long. Its entire body is covered with scales, reminiscent of armor plating. It belongs to the Osteoichthyes class of bony

3. #3 peak

   dry and itchy skin. Severe cases of dermatitis can result in skin forming crusts or blisters which ooze fluid. There are different types of dermatitis and these are

4. #4 peak

   balustrades were ornately molded in pre-cast faux stone and lighting was generously provided from electric globes on eleborate cast-iron poles… large plinths marked the foot of the structure at both ends. The four rusticated

5. #5 peak

   fact that man cannot make any progress without effort and hard work. For example, one who studies whole-heartedly becomes a scholar. Similarly, a farmer who ploughs the farm, sows seeds in it and waters them, is soon

6. #6 peak

   wagons.⏎With the start of railway rehabilitation in the 1950's, two underframes from scrapped wagons were utilised to build ballast ploughs. These ballast ploughs were towed by ballast trains

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   reports that influenza has resulted in nine to 45 million illnesses, 140,000 to 810, 000 hospitalizations and 12,000 to 61,00

2. #2 peak

   In fits and spurts, France has sought to extract itself from la Francafrique and to

3. #3 peak

   vessel walls and lower pressure.⏎High blood pressure is a key risk factor for heart disease, contributing to 47% of heart attacks and 54% of strokes worldwide, the authors write. They note that the risk of heart attack and

4. #4 peak

   -breaking 40-year-long continuous mission.⏎The Landsat mission is the longest continuous effort to image the Earth, and it has endured many setbacks, failures and near cancellations to get to this moment. Landsat 8 will both rescue the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.