'that' after 'the way' or 'the first time'

What this neuron does

This neuron lights up on the word 'that' when it follows phrases like 'the way' or 'the first time', as in 'the way that decimals are written'. Turning it up did not produce a clear pattern in the continuations.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   before the answer.⏎Subtracting money is easy, too, so long as it is once more remembered that money has to be written and subtracted the way that decimals are written and subtracted. Dollars go to the left of the decimal point

2. #2 peak

   happy to report that the seeds that were transported to the moon have sprouted! While plants have grown on the International Space Station before, this is the first time that any biological material has grown on the moon. Why is this so important? Because

3. #3 peak

   3 August 2012⏎Have you ever stepped out into a narrow city street and began to cough? You may have been a victim of the way that 'street canyons' trap polluted air, keeping harmful substances like nitrogen dioxide

4. #4 peak

   study was posted online Dec. 29 in advance of print publication in the journal Proceedings of the National Academy of Sciences.⏎While this is not the first time that microbes in the human intestinal tract have been sequenced as a community, this is

5. #5 peak

   should be able to find references or spell the word the way that it sounds.⏎Students should be writing for a variety of purposes.<|endoftext|>The Solar

6. #6 peak

   harmful ones are bred out. But the “adaptive” nature of the changes natural selection (praise be upon it) wreaks may not be the only way that complexity grew.⏎Protein flaws called “dehydrons” may have made proteins

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   first author, Dr Damian Scarf of the University of Otago’s Department of Psychology, they performed this feat by tracking the statistical likelihood that “bigrams,” letter pairs such as “EN” and “AL,” were more likely associated with

2. #2 peak

   - The messages contained within⏎- Illustrates human behaviour in any given situation and/or predicament⏎- Gives rules on life and living⏎- The romance of the narrative⏎- You have heroes

3. #3 peak

   itself because its already in your mind, because if it does completely undo itself then there’s no memory of that experience anymore. People need to keep these memories because; these memories or remembered experiences make you wise and give you knowledge. Either congenial

4. #4 peak

   ]⏎- In case of other than assigned generator class, suppose if our generator class name is Increment means hibernate it self will assign the primary key id value into the database right [ other than assigned generator, hibernate only used to take care the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.