'seen' after 'never' or 'rarely'

What this neuron does

This neuron responds to the word 'seen' when it comes after words like 'never', 'rarely', or 'last', as in 'had never seen'. Turning it up did not produce a clear, consistent change in the writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   of its western relative, the Ivory-Billed Woodpecker. The bird was last seen in 1944, and recently has been declared extinct.⏎A kay

2. #2 peak

   To be honest, those fruits look like the breasts of a cow. I have never seen this plant in any other country, yet it is hard to imagine something so flashy

3. #3 peak

   focused on to overcome many of the more frequently seen injuries by orthopaedic therapists. It is these similarities which have encouraged many therapists

4. #4 peak

   Matt 2008?” video is a great example of the impact of music on images and changes how we look at it.⏎In case you haven’t seen this,

5. #5 peak

   , to thin the herds. So far, it is working.⏎Contrary to my story, wolves don’t normally attack people. They’re shy animals rarely seen by visitors.⏎Until releases this week from Science Advances, it was believed there were

6. #6 peak

   spy lots of different kinds of leaves lying on the ground. Some were leaves I had never seen. Some were still green, while others were changing to their autumn colors.⏎Have

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   (reigned 1187–56 bce) who defended his

2. #2 peak

   (So do we, which is why we laugh at this monk's struggles.)⏎Here

3. #3 peak

   (GNBDK)⏎Never do to anyone else anything that you would not want someone

4. #4 peak

   (p. 136) and recognized by Hans Reichelt (pp.

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.