'it' referring back to a noun

What this neuron does

This neuron fires on the word 'it' when it points back to a thing mentioned earlier, such as 'In other words, it's the ability' or 'what it means'. Turning it up made the output repeat 'is' and 'knows', so the steering does not match the trigger closely.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   did. 4⏎|NET © Notes||⏎1 tn In this place the verb חָזַק (hazaq) is used; it indicates that God would make Pharaoh’s will strong or firm.⏎2 tn The

2. #2 peak

   vs Empathy: What Is the Difference?⏎What Is Empathy?⏎Empathy is the ability to put yourself in someone else’s shoes. In other words, it’s the ability to feel or understand another person. Experts suggest it’s innate in

3. #3 peak

   they resemble the pointy nose and ears of a fox.⏎By the way, that likeness inspired another name — fokkusu feisu — which, because it’s written in katakana and includes the English words “fox” and “

4. #4 peak

   78 degrees Celsius, even for a few seconds, is enough to kill most bacteria, viruses, or parasites. Toxins produced by bacteria<|endoftext|>Dit artikel staat op icthealth.nl. Link: https://ictandhealth.com/u

5. #5 peak

   in a big world. Bravery is having the courage to go out every day and tackle what comes, no matter what comes. These creatively structured poems explore what it means to cultivate respect for self and others, the meaning of good qualities, and

6. #6 peak

   19<|endoftext|>毋忘在莒(Pinyin: Wu Wang Zai Ju) is a famous Chinese idiom (成語, Pinyin: Cheng Yu). It is sort of like the Latin idiom left in the European language. Most are

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   varied, from about 5.5 to 8 inches (13<|endoftext|>by Kong Dehao⏎The search for extra-terrestrial intelligence (SETI) celebrates its 58th anniversary this year (Nature, 20

2. #2 peak

   had twice been admitted for “exhaustion” and doctors were observing the chronically fatigued young man. Beds of wounded men lined room around him.⏎Everything fell to a disciplined hush when the six-foot, two-inch General George S

3. #3 peak

   on account of race or color.⏎With the Civil Rights Act turning 50, the success of the struggle for equal rights for women and minorities<|endoftext|>The No Child Left Behind Act, signed into law by President Bush January 8, 2

4. #4 peak

   been caught by the Roman authorities, but others had renounced Christianity in order to stay alive. At first no one had much choice in the matter; too few clergy were willing to make themselves known

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.