'that' after a noun, 'being' in passives

What this neuron does

This neuron responds in two ways: it fires on the word 'that' right after a noun that starts a describing clause, like 'the financial issues that break us'. It goes strongly negative on 'being' in phrases like 'the behavior being pressured'. Turning it up or down gave mostly unrelated, looping text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   from Kiku Hughes.⏎Kiku is on vacation in San Francisco when suddenly she finds herself displaced to the 1940s Japanese-American internment camp that her late grandmother, Ernestina, was forcibly relocated to during World War II.⏎

2. #2 peak

   ability to speak a first language, are thought to be due to the inbuilt genetic process. It is said that children naturally become interested in the sounds and signs that they see around them and the ability to speak ‘unfolds’.⏎Although

3. #3 peak

   can easily incorporate this kind of activity into your daily regimen. Simple activities for preschoolers must enable them to discover about shades, shapes, as well as other items that interest them.⏎A deck of playing cards can be reworked right into a number

4. #4 peak

   then.) He had just gotten his PhD at Caltech under Richard Feynman, and was busy trying to understand the “zoo” of hadronic particles that were being discovered in the 1960’s. (Side note:

5. #5 peak

   This teaches your tween about the importance of communicating about money.⏎#5. Talk About Financial Options.⏎One of the hardest parts of life is encountering the financial issues that break us. Talking about the different

6. #6 peak

   Weingarten: Most of our educational systems have been created to an industrial model. They were built to ensure that kids could competently deal with the routine tasks that were necessary in factories. Some kids would succeed in a different way; but in

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   child attempting to reproduce them based on a child’s own free will. Peer pressure is the act of one child coercing another to follow suit. Often the behavior being pressured is questionable or taboo, such as smoking cigarettes or drinking alcohol.⏎Peer Pressure

2. #2 peak

   the decimal and cents to the right of the decimal. To add decimals, simply line up the decimal points of the amounts of money that are being added. When you have added the amounts of money, be sure to place the

3. #3 peak

   language around 1600, the word meant to cook something slowly and gently in water that is just below the boiling point. Usually eggs are what's being cooked when "coddle" is used in this sense today, but when

4. #4 peak

   More recently, a myopic focus on growth has created a dream that promotes unbridled consumption, but the “more is better” version actually harms the very things we cherish. It is unsustainable personally, as it draws American families into a work

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.