'for' after a span of time

What this neuron does

The neuron lights up on the word 'for' when it comes right after a length of time, as in 'for several weeks' or 'for years'. When it was turned up, the model kept drifting into talk about how long something lasts, such as 'for a long time' and 'a few days'.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   the city was almost destroyed. The conflict spread to outlying provinces.⏎By 1530, the wars of the Sengoku Period had been fought for over two generations. At that point, there were nine major

2. #2 peak

   only hinted at by the book.⏎I have admired Dick’s work for years, but this is his best. He delves more thoroughly into many themes

3. #3 peak

   has helped me to uncover student misconceptions and look into their thought processes regularly. A supervisor gave me the book in August, and it sat on my nightstand for several weeks. In my mind, it was going to be another book about visual

4. #4 peak

   mental illness, affecting more than 350 million people worldwide, according to a Reuters video. Bob Holmes is one of them. "I struggled with that for many years, didn’t know really what to do, tried to pull myself through

5. #5 peak

   England, in 1813 and made a career for himself as a renowned architect, engineer and surveyor. After living in Dublin for several years in the early 1830s, Lanyon moved

6. #6 peak

   and challenges for these individuals truly is a spectrum that can range from a completely nonverbal kindergartner, to a professor of linguistics.⏎We’ve known for more than 20 years that the lion’s share of the risk for developing

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Assessment's Biogeography Branch (BB) has been conducting research in Puerto Rico and the US Virgin Islands since 2000 and 2

2. #2 peak

   process improvements are elastic and, unless rigorously monitored, drift back to their original state. Determin<|endoftext|>Archeological sites are places where people have lived or worked in the past and

3. #3 peak

   <|endoftext|>The term “education technology” (or “edtech,” as it’s commonly known) refers to more than just learning via computer. Edtech has existed in various forms for as long as education itself has been around. At the beginning of

4. #4 peak

   .⏎The Hasinai group of the Caddo tribe built a village in the area about 800 A.D. and continued to live in the area until the 1830s, when they migrated to the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.