'st' starting a word fragment

What this neuron does

The neuron lights up on the letters 'st' when they start the second half of a word that gets split up, like 'sto' in stoma or 'stav' in staves. When it was turned up, the model's replies drifted into odd, repetitive phrasing rather than anything clearly about those words.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   banding is specially designed to limit food consumption in severely obese patients. When placed around the patient's stomach, the saline-filled band forms a small gastric pouch and stoma. Inflation of the band can be adjusted to control the amount of food

2. #2 peak

   first step should be to become familiar with the music notes.⏎In the Western system of music notes, written music is arranged on two sets of five lines, called staves. The upper stave is called the treble stave; the lower

3. #3 peak

   take your chances in the no-holds-barred class, or on the roof.⏎Passengers were still pushing their way on board and trying to find somewhere to stow their endless boxes and bags of luggage when a bell clanged and we were

4. #4 peak

   chunks of dirt and remove rocks. The axe-style blade on the head of a cutter mattock is ideal tool for chopping through root-laden soil near tree stumps.⏎Forks are particularly useful for turning soil, digging up root crops,

5. #5 peak

   may rise by 3,000 percent by 2029 with better regulations.⏎The ever increasing demand for carbon credits could be the straw that stirs the milkshake for climate innovation in Mongolia and possibly resolves the air pollution problem

6. #6 peak

   for domestic rubbish. This is because the biomass in domestic rubbish can only be gasified at low temperatures, but this in turn creates tars and waxes that stifle the process.⏎However, it turns out that these tars and waxes

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   a thin, flimsy plastic but you could, and still can, buy proper-lensed 3D blue and red glasses) use what is called anaglyph technology. This has since been superseded by Passive and Active 3D

2. #2 peak

   wall next to the art, a statement from the artist about their intent for the piece.⏎When Marcel Duchamp submitted an upside-down porcelain urinal signed “R.Mutt”<|endoftext|>The Galileo Museum in Florence is an international reference on Galileo

3. #3 peak

   Re became Tefnut's father. According to one myth, Tefnut became angry with her father Re and ran off to Nubia. The god Thoth went to find her and conjoled her into returning to Egypt.⏎

4. #4 peak

   00-205. See general information about how to correct material in RePEc.⏎For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Michael McNulty

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.