"of" or "on" after part, face or footprint

What this neuron does

This neuron fires on small words like "of" or "on" that come after nouns such as "part", "face", "footprint" or "set foot" and before a place, as in "set foot on the moon". Turned up, the output did not show a clear matching theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   away. The light we see today, comes from a time 10 million years after the dinosaurs were extinct. It was long before any human walked the face of the Earth. And for all we know, this star has gone supernova many

2. #2 peak

   Rights Act” of 1964. The whole world watched in awe and amazement as Neil Armstrong became the first human being to ever set foot on the moon. The

3. #3 peak

   this is a great exercise. Split the class up into groups and have each group color a large panorama of a landscape. Place different landscapes and habitats in different parts of the room. Provide pictures to the students so that they have a general idea of

4. #4 peak

   ’s also a lot of history. NASA is worried that without some guidance and agreement irreplaceable relics of the Space Age, such as Neil Armstrong’s first footprint on the Moon could be lost and sites needlessly disturbed. More than that, many

5. #5 peak

   tool for building students' critical thinking skills. It can be used in class, assigned for homework, or offered as a challenge or reward activity. The best part of all: as students learn to complete the puzzles they will be building confidence in their

6. #6 peak

   with the bond between man and woman.⏎Why is it so hard to get possessives and plurals right? Wait, no, that’s not my favorite part of the blog. And it’s not Pocahontas, or Confuc

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ⏎other States. It was not until the 90s when the colonies were promoted to States and the Commonwealth was founded.⏎State corporativism is the norm in Portugal, and imports and exports are rare as the government's aim is still

2. #2 peak

   USA status by meeting four core standards of sound urban forestry management: maintain a tree board or department, having a community tree ordinance, spending at least $2 per capita on urban forestry and celebrating Arbor Day.⏎Alison Oelschl

3. #3 peak

   what distinguished Tupac's music⏎You're talking about an artist who came from the people and decided that his work was going to reflect the conditions that were going on in America during his lifetime — his short 25 years on this planet.

4. #4 peak

   ripe old age?<|endoftext|>Sixteen years ago, Patricia L. Gerbarg, a Kingston, N.Y., psychiatrist, contracted Lyme disease. But as sometimes happens, her blood tests were negative, so the condition was not diagnosed for five years

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.