unclear: mixed mid-sentence words

What this neuron does

This neuron fires on a grab bag of ordinary words in the middle of sentences, with no clear shared meaning. Turning it up made the model's text drift into unrelated topics and repetitive loops, so it doesn't seem to control one clear behaviour.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   511 Fourth Avenue Southeast in 1858. Woodbury Fisk, also a native of New Hampshire, came to St. Anthony in 1856 and became a principle in the flour milling firm of Pillsbury

2. #2 peak

   , Jane Hurley Wilson ’64 and Michael G. Wilson, and the Getty Foundation.⏎Daniela Gonzalez-Pruitt, University of Toronto ’17 and Josephine Ren, SCR ’19⏎Stories Behind the Scenes⏎In his

3. #3 peak

   one of these, and imagine dividing it into 10 pieces. Then take one of those pieces, and divide it into 10 more pieces. Now take one of those pieces, if you can find one, and divide it, once

4. #4 peak

   sugar levels. Ginger, another key spice in pumpkin pie, is well-known for its benefits as a digestive aid and is particularly helpful for nausea. Cloves can benefit digestion and the immune system, and nutmeg can

5. #5 peak

   can be compared with the expected number of answer matches. Example: John (62 correct out of 100) and Barbara (67 correct out of 100) answer 89 questions exactly the same way. Scan

6. #6 peak

   15||ARAB 200 AND ARAB 300⏎|FALL 2015||ARAB 100 AND ARAB 210|⏎|SPRING 2016||

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   in Orange County, California have been professionally diagnosed with autism, Down syndrome or some form of developmental disability.⏎According to the U.S. Census Bureau, more than 1 in 150 children are diagnosed as having an Autism Spectrum Disorder.

2. #2 peak

   , either as a victim, a perpetrator, or both. The American Academy of Child & Adolescent Psychiatry believes the problem is even more widespread, reporting that as many as 50 percent of all young people are bullied at least once during their school

3. #3 peak

   Scotland, and granddaughter of Kenneth III .. At the instigation of her father Gruoch was married to Gillacomagnan Earl of Moray. The son of this union, Lulach, followed his stepfather to the throne of Scotland

4. #4 peak

   19% with prostate cancer; and 10% with colorectal cancer.⏎Those three cancers accounted for slightly more than half of all cancer diagnoses.⏎Nearly 60% of survivors were 65 or older, the report found.

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.