'that' after nouns of belief or fact

What this neuron does

The neuron lights up on the word 'that' when it introduces a clause after a noun or verb about a belief, fact, or sign, like 'a clue that this is happening' or 'a belief that underlies'. The opposite side fires on verbs like 'say' or 'indicates' that come just before an expected 'that'. Turning it up did not give a clear theme in the writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   hormones which release stored sugar from the liver into the blood. The blood sugar may remain high for up to 3 days after a low blood sugar. A clue that this is happening is seeing 1 to 3 days of high blood sugars with

2. #2 peak

   a trendy restaurant. Suddenly, my simple domestic pleasures paled in comparison with the things I could be doing."⏎Grohol said that fear is "a legitimate sense that some people have. But I think it's sort of a false dichotomy.

3. #3 peak

   sealing components implemented that prevents all ice dams and ice formations.<|endoftext|>Machu Picchu, Peru⏎Everything about Machu Picchu makes you marvel that it ever came to exist. The lost city of the Incas is built on

4. #4 peak

   very anxious that perhaps he had committed some error because of which his Lord had become angry with him and had forsaken him. Thereupon he was given the consolation that revelation had not been stopped because of some displeasure but this was necessitated by

5. #5 peak

   guerilla war they really had no hope of winning but did.⏎Part of the reason they won…other than sheer suicidal bravery and determination…was another belief that underlies the two involving women discussed here: Resurrection.⏎I came to identify

6. #6 peak

   all Akali dal factions including their popular preacher- Bhindranwale. One instance led to another and there was burgeoning mistrust amongst the average Sikh mind that their community was not trusted by the Indian government.⏎During this course, the Ak

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   lack of academic resources, or poor mentorship and guidance – the reason for all is somehow rooted in the COVID-19 pandemic. Of course, you might say that

2. #2 peak

   start the next paragraph, list, heading or whatever.⏎Strictly speaking a page should start <HTML> and should end </HTML>, but the HTML specification also says that clients should perform correctly without them, and so many people omit them. Similarly

3. #3 peak

   ?⏎Based on our data, we think this problem is relevant for Professor Finnegan's class at WSU.⏎What textbook is this problem found in?⏎Our data indicates that this problem or a close variation was asked in Chemistry: An Atoms First

4. #4 peak

   is not a nation. Indeed,⏎Constitutional experts say the motion carries no legal weight and would be unlikely to give Quebec separatists a

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.