comma before a describing clause

What this neuron does

The neuron fires on the comma or short word right after the subject of a news-style sentence, just before the extra detail about that subject starts, such as 'The workshops[,] which are funded by...'. Turning it up did not produce any clear topic in the model's output.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   show her students live feeds of animals they are learning about so they can see the animals in their native habitats, rather than simply pictures in a textbook.⏎The workshops, which are funded by the Bristol-Myers Squibb Center, are offered

2. #2 peak

   curl and have turned brown.⏎"I think it has aborted a lot of the acorns. And the leaves turn upside down to keep from losing moisture."⏎The tree, which stands at least 90 feet tall, was estimated by the MU Fore

3. #3 peak

   31 years at Phoenix Zoo⏎A bald eagle that spent 31 years in the Phoenix Zoo has died, zoo officials announced Wednesday.⏎The bald eagle, named Polaris, was originally rescued in the state of Washington with a broken wing

4. #4 peak

   -versus-large-truck speed differentials on rural, interstate highways. Sponsored by the U.S. Department of Transportation, commercial trucking companies and private fleets, the study will help regulatory agencies and trucking-company decision-makers establish policies regarding speed limits

5. #5 peak

   ’s rights activist, author and feminist icon Kamla Bhasin passed away today, September 25, following a brief battle with cancer.⏎Bhasin was a stalwart of the women’s movement in the South Asia region, who spent

6. #6 peak

   primates following exposure to Delta-9-tetrahydrocannabinol, or THC, the main psychoactive ingredient in marijuana.⏎The nonhuman primates, all of reproductive age with a history of successful conception, received a THC edible once

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   power amplifier design.⏎The first aim of this text is to fill that need, by providing a detailed guide to the many design decisions that

2. #2 peak

   coupled with novel molecular dynamics-driven structural refinement to understand the biological roles of higher-order structure in the hepatitis C virus (HCV) RNA genome.⏎Our Specific Aims are designed to reveal numerous new roles for RNA structure in the replication cycle of H

3. #3 peak

   the mini essay completed in July OR starting afresh, write a detailed report about use of harmony in Haydn’s Joke quartet. Start with the sentence ‘Like the Corelli, the harmony in Haydn’s Joke

4. #4 peak

   physiography,"⏎says George Zandt, a geophysicist with the University of Arizona in Tucson,⏎and lead author of the study, which appears in today's Nature.⏎"Normally, you have the greatest thickness underneath the tallest mountains

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.