the 'pre' in pre-words

What this neuron does

This neuron lights up on the start 'pre' of words like prehistoric, prehistory and pre-Civil War, where the word is split and 'pre' comes first. When it was turned up, the text drifted toward unrelated fragments and repeated phrases, so the push did not produce a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   States.⏎Kahlo’s artistic sensibility and signature style developed in full. Her main source of inspiration was Mexican folk culture, which she blended with elements from pre-Colombian and Catholic mythology in her paintings.<|endoftext|>|Wednesday, 3

2. #2 peak

   apparent spatial dimension to the site, it appeared possible that activity specific areas might be detected. Other reasons for selecting this site included the absence of knowledge concerning the late prehistory of this area, the rapid rate of erosion and destruction occuring

3. #3 peak

   2011 - Nightlife during the Mesozoic era was full of activity and fraught with dangers, suggests a new study that found some dinosaurs and prehistoric reptiles were nocturnal, with carnivorous dinosaurs likely sneaking up on

4. #4 peak

   while the old countries, populated since prehistoric times, each have their great groups of related motifs: the supernatural light creature

5. #5 peak

   describes, “the piers of the bridge were festooned with statuary of mermen on dolphins. The bridge balustrades were ornately molded in pre-cast faux stone and lighting was generously provided from electric globes on elebor

6. #6 peak

   It’s a 50-episode story that follows the time-traveling adventures of a little boy and his trusty computer companion, as they explore the prehistoric world. Listen to the episode here.⏎Now that you’ve listened to the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   to the very essence of how the Universe expresses itself.⏎He begins by stating that all tathagatas are without Buddha nature although they have arrived in the state of reality. A

2. #2 peak

   works such as Prayers or Meditations in 1545, she became not only the first English Queen

3. #3 peak

   . People are strongly advised to take special care if a water supply contains two VOCs, however, even if they are both below the maximum allowable concentration.⏎Bioworx has just come out<|endoftext|>Nikola Tesla Articles⏎Tesla, a

4. #4 peak

   Nature Beyond Conditions and a commentary by Rev. David Xi-Ken Astor, Sensei⏎BUDDHA NATURE BEYOND CONDITIONS⏎“All tathagatas are without Buddha nature, but at the same time, previously they have fully

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.