'that' starting a clause after a noun

What this neuron does

This neuron lights up on the word 'that' when it introduces a statement after a noun, such as 'the notion that', 'the maxim that' or 'a dream that'. Turning it up made the model get stuck repeating words, so the steering output is not very informative.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ’ birthdays are on the other hand one of the grandest holidays of the year. All this is not surprising given North Korea’s reputation. There is a fact that may be more of an eyebrow raiser.⏎New Years is widely accepted and celebrated

2. #2 peak

   the system, such as it was, took care of the people (at least some of them).⏎Eventually, Golway argues, Tammany Hall introduced the notion that the government had a social welfare role to play. Laissez-faire capitalism

3. #3 peak

   Legislature in regards that might be put forth that would direct all the school districts in the state as to how they should address bullying

4. #4 peak

   Yom Ha' Shoah is not just a Jewish event — it touches everyone,” she says.⏎“Yom Ha' Shoah is a wake-up call that genocide is happening now and we have the power to stop it.”⏎The event is

5. #5 peak

   at Austin): There's no principle built into the laws of nature that says theoretical physicists have to be happy.⏎NARRATOR: It's a game-changing perspective that opens up a whole new world of possibilities. Coming up: what if new univers

6. #6 peak

   what comes. These creatively structured poems explore what it means to cultivate respect for self and others, the meaning of good qualities, and to hold fast to the maxim that ‘anything is possible.’⏎Because Brave. A Book about Courage is authored by

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   .⏎On the other side of the world, the Mayans are believed to have utilized the gum from the manilkara chicle evergreen tree (yes, that’s the inspiration for “Chiclet”) in a

2. #2 peak

   samples incorrectly, an oil-analysis program is a waste of time and money. Key guidelines include:⏎- Take warmed-up machine samples while equipment is running. If that’s not possible, sample no later than 30 minutes after shutdown⏎-

3. #3 peak

   form of life, they point out, this is simply an example of a normal form of earth life adapting in a remarkable way to harsh conditions. Well, if that's the case, I don't know what all the fuss is about. We

4. #4 peak

   for New Scientist and estimated that PCB levels would only rise above normal ocean concentration within 1 kilometre of the ships and are unlikely to harm marine life even in that area. "It's not an ethical thing to do," Lohmann says

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.