'that' starting a new clause

What this neuron does

This neuron lights up on the word 'that' when it is used like 'this' or 'that' to refer back to something just said, as in 'and that percentage' or 'of course that isn't always the case'. When it was turned up, the model's text drifted into rambling and repetition rather than a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   é’s population is 2.5 million. The urbanization rate is currently 3.3%; 58% of the country is urbanized and that percentage continues to grow annually.⏎Cameroon’s population is made up of its indigenous

2. #2 peak

   <|endoftext|>Homeowners across a large swath of Pennsylvania are reporting sightings of spotted lanternflies hatching from egg masses.⏎“Egg-hatching season is here, and that has some people on edge,” said Emelie Swackhamer, a

3. #3 peak

   . You can communicate a thought, but your thought may not be understood. In some cases, your thought may not even reach the proper target. Thats why it pays to ask questions to make certain that people understand what you are saying

4. #4 peak

   good listener.⏎Over a period of 240 years there has been 44 presidents and the U.S has had both good times and bad times and that all depended on who was running the country and what choices they

5. #5 peak

   stakes and adrenaline during a game. (Or a whimsical ‘why not’). But of course that isn’t always the case.⏎A total of 64% of Australian adults

6. #6 peak

   00. But of course that’s not what you’ll actually receive.⏎Your employer is required to withhold federal and

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   2. Every day the boss enters the office⏎at half past nine⏎3. My friend will ring me up at eight o’clock⏎4. Where was Kate going when you met her yesterday?⏎does your brother work?⏎6. What

2. #2 peak

   God Himself standing over him in judgment. “Where were you hurt?” the general asked in his high-pitched voice (Patton sounded

3. #3 peak

   expelled the only red state in the national organizaton" -- but<|endoftext|>Raising Our Children to Be Gatekeepers⏎And the LORD said unto Cain, Where is Abel thy brother? And he said, I know not: Am I my brother

4. #4 peak

   )<|endoftext|>High: 77°F ~ Low: 59°F⏎Monday, Sep. 15, 2014⏎"Where's The Beef"Posted Friday, October 9, 2009,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.