'that' after a noun, introducing a clause

What this neuron does

This neuron fires on the word 'that' when it follows a noun and starts a describing clause, like 'the data that was being sourced'. When turned up, the model's writing drifted into rambling, repetitive text rather than anything clearly tied to this pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   of this activity meant that we had to leave the standard classroom and venture into the school gymnasium.⏎With this is mind I wanted to ensure that the data that was being sourced within the session would be instantly displayed for the students to analyse.

2. #2 peak

   is good for your garden soil, it’s not the best thing to add to your compost pile. This is because it takes a very long time for the bacteria that eats dog waste (and its nutrients) to be broken down. To make things

3. #3 peak

   up to date, call Dr. Shaheedy's office.⏎As you age, your body's immune system will also change. This may mean that the antibodies that were produced by previous vaccinations may have weakened or the viruses they were designed to prevent

4. #4 peak

   , there was not enough-if any-on daily Roman life, which, to me, was and is much more interesting. Some people might argue that all the information that you gain from museums is in books, but where do the pictures and some of

5. #5 peak

   fiscal impact of the budget’s policies over the next ten years. The CBO does not generally look at the long-term impacts of these policies, so the numbers that ultimately shape the public debate are ten-year numbers. This introduces a serious bias into

6. #6 peak

   The separate video card plugs into a slot on your board and provides your computer with a second sub-processor called a GPU (graphics processing unit). All the calculations that are needed to turn the computer code into the picture on the screen are given over

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ier has made waves with its fresh look at adolescent sexuality⏎Almost half of American adolescents report having had sex by the time they graduate from highschool — a fact that has raised concern among adults, and parents of teens in particular, about the emotional

2. #2 peak

   the system. Incorrect data sometimes produce an erroneous result that reduces the quality of data. To handle this problem web Miner's has introduced several

3. #3 peak

   economic stimulus packages in 2014 to bolster growth, including reforms to environmental regulations in order to spur investment in Peru’s lucrative mining sector, a move that was opposed by some environmental groups. However, in 2015,

4. #4 peak

   ) and Maila (later called Mary), with his first wife, who died in 1822. Hirsch later married Rebecca Haas, with whom he had two children, Vogela (later called Fanny) and Loeb

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.