"this" in time and context phrases

What this neuron does

This neuron lights up on the word "this" when it starts a phrase about the current moment or situation, like "this week", "this autumn" or "this case". Turning it up didn't produce a clear theme in the written text, and the model drifted into unrelated topics.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   The Columbia Daily Tribune the drought has been hard on the prized specimen.⏎"The drought of '80 was different," he said. "That was hotter, but this one is longer."⏎The U.S. Drought Monitor this week said more than

2. #2 peak

   a half century ago.⏎“Just watching that moment was pretty dog-gone exciting,” he said. “It was just like, ‘wow,’ can you believe this is actually happening?”⏎It did finally happen.⏎After years of space exploration,

3. #3 peak

   sparking new actions that will help benefit individuals with autism, and their families, in the years to come.⏎April is World Autism Awareness Month, and three years ago this week, OHSU and more than 20 other sites across the U

4. #4 peak

   seems as if every time Israel defends itself, somebody points an accusing finger and yells “Genocide!” Raphael Lemkin, who coined that term seventy years ago this autumn, would have been appalled by such abuse of his life’s work.⏎

5. #5 peak

   in Seattle, who heads the UNOS living donor committee.⏎"We really do need to take a look at things again in real time to say, OK, in this current climate what are our risks?"⏎More than 90,000

6. #6 peak

   girls have a difficult time getting an education. The sons of these workers — very much like the sons of their richer counterparts — are treated like kings, or in this case pauper-kings. They get the lion’s share of whatever little food

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   anam. In that the poet relates the life story of one Punithavathiar who abandoned the

2. #2 peak

   steady progress toward the human exploration of the solar system and beyond. In that expectation, we were cruelly disappointed. Partisan politics, a collective failure of

3. #3 peak

   joined the Loyola community in 2013 and currently serves as the Senior Associate Director in the Academic Advising and Support Center (AASC). In that role, she advises undergraduate students and works closely with the transfer student population, assisting

4. #4 peak

   September 10, then received the name of Hurricane Humberto at the first report of the National Hurricane Center (NHC) the next day. At that time the hurricane was located about 310 mi (500 km)

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.