the 'res' fragment inside words

What this neuron does

This neuron fires on the syllable 'res' when it sits inside a longer word, such as resold, resented, resided, respiration or resurfacing. Pushed down, the model produced a stream of commas, which fits its tendency to suppress commas.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   them is more profitable?⏎Previously it was all simple. Every person who sold or resold something was called a trader. But nowadays everything has changed: dealers, distributors

2. #2 peak

   wet. Plants are intolerant of root disturbance and should be planted into their permanent positions whilst still small. Division in spring is very difficult, since the plant strongly resents root disturbance. It is probably best to take quite small divisions, or basal

3. #3 peak

   development.⏎During the early years of St. Anthony and after the merge, Fifth Street Southeast remained one of the finer streets of residence. Many of the people who resided in this neighborhood were merchant families originally from New England. The flour and milling

4. #4 peak

   the incomparable Bill Murray as Phil Conners, an insufferable Pittsburgh weatherman. A minor local celebrity who believes himself destined for much better things, he resents

5. #5 peak

   's allowable specifications.⏎A brake rotor has a specified minimum thickness. The brake rotor must measure thicker than the manufacturer's minimum or discard thickness after the technician has finished resurfacing the rotors. Normal braking action can cause wearing of the rotor surfaces

6. #6 peak

   sensitive index of respiratory function, showed that mtDNA from chimpanzee, pigmy chimpanzee, and gorilla replaced the human mtDNA and restored respiration to essentially normal levels. Mitochondrial protein synthesis was also unaltered

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   by John Kennedy at Rice University in Houston in September of 1962:⏎“We choose to go to the Moon in this decade and do the other things, not because they are easy, but because they are hard, because

2. #2 peak

   among savages than among civilised men. Notwithstanding the differences which necessarily exist between savage and civilised ethics, the two systems must evidently have much in common, for from the days of Columbus to the present, travellers have given testimony of customs

3. #3 peak

   object is fulfilled by the supramental being's appearance. But there is no such stress in reality: the idea of human progress itself is very probably an illusion, for there is no sign that man, once emerged from the animal stage, has

4. #4 peak

   Street View is available, the image is from the best available vantage point looking, if possible, towards the location of the monument. Where it is not available, the satellite view is shown instead.⏎Latitude: 52.516

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.