unclear: word-initial pieces of longer words

What this neuron does

This neuron fires on the first pieces of longer words that have been split up, such as 'fore' in 'forebears' or 'Fur' in 'Furstenberg'. Turned down, the model got stuck repeating 'perfect' or 'nature'. The pattern is loose and the examples do not share one clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   . Beneath the castle is a network of tunnels, a barracks during the Napoleonic Wars and a military command centre during World War II.<|endoftext|>Our English forebears just partly anglicized a German term back in the sixteenth century

2. #2 peak

   , la him/her/you formal||los, las them/you plural|⏎A direct object

3. #3 peak

   A Memoir⏎- The Woman I Wanted to Be. Diane Von Furstenberg⏎- Dressed: A Century of Hollywood Costume Design⏎- Secrets

4. #4 peak

   (the angle at which a mineral goes black and you rotate the slide) and birefringence (the colour of the mineral using crossed polars).⏎Minerals have different characteristics using the different types of light – plain polarised (P

5. #5 peak

   along the Pacific Coast. The climate is mild and the soil is fertile and easily farmed.⏎While medieval European medicine was still mired<|endoftext|>ASIAN WILD HORSE⏎SCIENTIFIC NAME: Equus Ferus⏎HABITAT

6. #6 peak

   sacrifice can be a message for each and every one of us.⏎Our Chamber of Commerce estimates the Treaty Oak to be over 600 years old. Most foresters settle on about 300,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   and beyond.”⏎Yersinia pestis is a bacterium responsible for tens of millions of deaths, most occurring in the course of three devastating global pandemics. Catastrophic as this

2. #2 peak

   to notice that they are actually different. Mind readers jump to conclusions that are true for them, without checking whether they are true for the other person.⏎5. Catastrophizing: You expect disaster. You notice or hear about a problem and

3. #3 peak

   scenes?⏎- What cuts are structural.⏎Example: Indiana Jones And The Last Crusade: the boat race in Venice.⏎After facing rats and burning waters in the catacombs<|endoftext|>Google has once again surprised us with another of their now infamous homepage

4. #4 peak

   caused about $84 billion in losses since then.⏎The Boll Weevil Eradication Program—initiated in 1978 by USDA’s Animal and Plant Health Inspection Service with ARS research support and run by eradication foundations

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.