'that' after reporting verbs

What this neuron does

This neuron fires on the word 'that' when it introduces a claim after verbs like 'reported', 'stated' or 'promised', as in 'the CDC also reports that'. Turning it up sent the model into vague sentences that did not clearly show this behaviour.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   by large bodies of cavalry and several regiments of infantry, while the heights on both sides were crowned by Russian artillery and infantry. Lord Raglan, perceiving that it was the intention of the Russians to carry off the guns they had captured from

2. #2 peak

   pe climates, usually border desert climates. In both climate groups, the temperature change between day and night is considerable. One reason for the wide swings in temperature is that the skies are clear and the air is dry. Clouds would reflect much of

3. #3 peak

   children tend to have more.⏎They estimate that more than 29 million Americans have a sinus infection or other sinus-related problems each ear.⏎The CDC also reports that influenza has resulted in nine to 45 million illnesses, 140

4. #4 peak

   the size of a similar-size hoofed mammal and eyes only a third as large.⏎The combined effect was that Myotragus was sluggish, with slow reaction times, the bone study suggests

5. #5 peak

   during this time, and that there was unequal access to maize between the sites, which the authors argue may have led to social tension through inequality.⏎The authors state that a combination of factors may have contributed to the high level of lethal trauma in the

6. #6 peak

   in the Old Testament, faith was the only way the Saints could receive God’s promises. In the Garden of Eden, God promised that one day a Redeemer would come. Their hope was a future hope. They

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   003.⏎This article compares three eighteenth century evaluations about jesuitic missions among the Guaranis - Relação abbreviada da republica, que os religiosos jesuitas estabelecerão no Paraguai

2. #2 peak

   grassy plateau that sweeps across the South African interior. The city bestrides the Witwatersrand, or Rand, a string of low, rocky ridges that constitutes the watershed between the

3. #3 peak

   ANE?⏎Hurricanes are tropical cyclones that occur in the Atlantic Ocean and have winds with a sustained speed of at least

4. #4 peak

   clothing sun protection,” by the Skin Cancer Foundation (1), UPF (Ultraviolet Protection Factor) treatment is designed to limit the amount of ultraviolet rays that penetrate your clothing’s fabric.⏎- SPF: On the other hand, SPF (

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.