unclear: mid-word pieces like 'sup' and 'mad'

What this neuron does

This neuron fires on small chunks of longer words, such as the 'sup' in 'supplied' or 'supersonic' and the 'Mad' in 'Madinah'. It does not seem to care about the topic. Turning it up made the model produce loose, repetitive text with no clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   foremost combat weapons.⏎Acknowledging the significance of the availability of good shields for successful warfare, Carolingian rulers took special care to ensure that their soldiers were well-supplied with ample shields.⏎Shields were used by both the cavalrymen and infantry

2. #2 peak

   North and Central America to provide population data for use in science and conservation biology and is the longest-running citizen survey in the world.⏎The Matagorda County Mad Island Marsh Christmas Bird Count (CBC) is one of the most successful in the

3. #3 peak

   pools or water parks.⏎- Use of Tampons⏎- Problems emptying the bladder completely⏎- Having a urinary catheter⏎- Kidney stones⏎- Suppressed immune system⏎- Immobility for a long period⏎- Holding your

4. #4 peak

   rows;⏎indeed, such sorrows were his bosom companions⏎in that frozen island dungeon⏎where Nithad fettered him:⏎so many strong-but-supple sinew-bands⏎binding the better man.⏎That passed away; this

5. #5 peak

   the 14,000-square kilometer Harrat Khaybar, located approximately 137 kilometers to the northeast of the city of Al Madinah (Medina). According to scientists, the volcanic field was formed by

6. #6 peak

   be the biggest of all dog breeds around the globe. They’re renowned for their majesty and imposing presence. While they are often gentle in nature and even mild-mannered members of many families, they’re still animals. Just like any dog

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   and not appearing to be surface feeding at all.’⏎- ‘And wigeon and scaup, teal and shovelers, buffleheads and a few mottled ducks.’⏎- ‘The sea ducks - common golden-eyes and

2. #2 peak

   his neighbours demonstrated that diversification of seeds and tubers, along with traditional methods of preparing the soil, enhanced crop and grassland yields. Although the region is economically impoverished, he showed that by reviving the diversity of their natural heritage, rather

3. #3 peak

   used mortality, and isolation of small populations are major concerns in the conservation of large carnivores (Clark et al., 1996; Singleton & Lehmkuhl, 2001). The loss of habitat and connectivity between

4. #4 peak

   stood out from the majority of artists living there. First, she was a single young female in a society that basically frowned upon such status. Second, she was financially independent, and third, she had received a typical "proper" education as beh

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.