commas in long lists

What this neuron does

This neuron fires on the comma or semicolon that separates items in a long list, such as a list of states, angels, or subjects. Turning it up made the model's text drift toward unrelated topics.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ians use this pattern so often that we have created a name and a symbol for it. 8×7×6×5×4×3×2×1 is written as 8! and we call it "eight factorial." You

2. #2 peak

   :⏎- Communicate effectively using Markel’s Eight Measures of Excellence: honesty, clarity, accuracy, comprehensiveness, accessibility, conciseness, professional appearance, and correctness.⏎- Evaluate the communication situation: audience, purpose, and context.⏎

3. #3 peak

   Society and Education; Compulsory Education and the Transmission of Culture; Sexuality and Education; Race; Multiculturalism, and Education; Social Class and Education; and Technology and Education.⏎- Stimulates critical thinking: The editor includes readings that

4. #4 peak

   the acronym Family ASSESSMENT—Structure, Socioeconomic, Sickness, Nutritional, Educational, Environmental, Affordability, System (health), Mental, Family influence, Threats. Under each domain,

5. #5 peak

   of Angels are as follows: godly Thrones, six-winged Seraphim, many-eyed Cherubim, Dominions, Powers, Authorities, Principalities, Archangels and Angels. Within these nine orders there exists three ranks: Ser

6. #6 peak

   in the three-day meeting were 52 young scientists from 18 countries (Argentina, Australia, Bangladesh, Brazil, Canada, France, Germany,Ghana,India, Italy, Nigeria, Poland, Portugal, Russia, Switzerland, United Kingdom

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , 07:44 AM⏎We are not going to do you homework.⏎If you want our help, you have to ask more specific what you need help with.⏎Have you looked at the macro that have been given to you?⏎

2. #2 peak

   akra system (spinning vortexes or wheels of light)? Would you like to know what each chakra represents? Here is a simple diagram and list for

3. #3 peak

   garden.⏎‘What are you doing here?’ he cried in a very gruff voice, and the children ran

4. #4 peak

   and is moved by a paddle with two blades⏎Headscratcher for kayak⏎Kayak is spelled the same forward and backward.⏎Seen and Heard⏎What made you want to look up kayak? Please tell us where you read or heard it (

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.