comma closing an introductory phrase

What this neuron does

This neuron fires on the comma that ends a short opening phrase, such as 'When hunger strikes,' or 'Despite the snow cover,', just before the main part of the sentence starts. When it was turned up, the model's replies did not show this pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   maintain. When hunger strikes, eating “on the go” can mean you are more likely to choose unhealth

2. #2 peak

   involved<|endoftext|>Extreme Winter Weather May Not Knock Out Insects and Disease⏎Despite snow cover, crop debris and soils still harbor pests⏎DES MOINES, Iowa, March

3. #3 peak

   environment.⏎Despite that good news, the study further concluded that deaths in the year of the study publication would be in

4. #4 peak

   ⏎- Zebra. …⏎- Western Green Mamba. …⏎- White Rhinoceros.⏎What is Africa’s deadliest animal?⏎Despite being vegetarian, hippos are considered the most dangerous terrestrial animal on the African continent. On average

5. #5 peak

   Uruguay and Argentina announced a boycott. The finalists of the first World Cup believed that tournament hosting rights should be alternated between Europe and South America.⏎Despite this controversy, Brazil and Cuba ensured the continent’s representation,

6. #6 peak

   outfit. When choosing accessories, it is<|endoftext|>Working and Careers in Water and Aquatic Science⏎A marine biologist

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   topic? Did your opinion about the subject change while you were writing? How did you decide what to include in the opening paragraph?⏎Or imagine a student who comes home from school announcing that "she had a great day because she got an A,

2. #2 peak

   right to complain. Our soldiers and sailors are deprived of all their freedoms except the right to grouse a little. But they will expect them back when they come home.⏎Fortunately in this war we are not on strange paths. The World War of

3. #3 peak

   your baby tummy time, it’s good to get a green signal from your pediatrician. Usually, parents can start tummy time as soon as they come home from the hospital. You could even use your lap as a support for the baby

4. #4 peak

   shod feet touch the ground are apt to come home with painful stings inflicted by a tiny insect with a long name: Solen

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.