unclear: weak, scattered tokens

What this neuron does

This neuron responds only weakly, and to a scattered set of word pieces with no obvious shared meaning. Its strongest examples are hard to tell apart from ordinary text, so it is best treated as a mystery.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   The answer to soaring gas prices lies in renewable heating, a technology that is ready to replace gas

2. #2 peak

   moral principle)⏎3. We ought to do something to help them. (ought)⏎

3. #3 peak

   Copyright © 1997, by Random House, Inc., on Infoplease.<|endoftext|>This was

4. #4 peak

   Pretty Balloons (counting/number sentences) (Resource Book Only) eBookKindergarten|Grade 1⏎Please Note: This ebook is a digital download, NOT a physical product. After purchase, you

5. #5 peak

   Temp. (Celsius)||-65|⏎|Max. Temp. (Celsius)||165|⏎There are no reviews yet.<|endoftext|>Talk about doing something in the blink of an eye.⏎Google wants to take that phrase to a

6. #6 peak

   - In search of their lost ones.<|endoftext|>The Verbal Reasoning section of the Graduate

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   aton & Olivier Dupriez, 2011.⏎"Purchasing Power Parity Exchange Rates for the Global Poor,"⏎American Economic Journal: Applied Economics,⏎American Economic Association, vol. 3(2), pages 137

2. #2 peak

   spell”November 23rd, 2010 - 6:33 pm ICT by ANI⏎London, Nov 23 (ANI): A study has suggested that Internet chatrooms and social networking sites are to be

3. #3 peak

   aceous amberJune 16th, 2010 - 1:53 pm ICT by ANI⏎London, June 16 (ANI): Palaeontologists have discovered two mammal hairs encased in amber that

4. #4 peak

   . Dwapara Yug<|endoftext|>Simple technique appears to be safe and effective, review suggests⏎By Robert Preidt⏎MONDAY, Oct. 15 (HealthDay News) -- A technique called the "mother's kiss" is a

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.