the word 'long' in phrases

What this neuron does

This neuron lights up on the word 'long' in set phrases like 'a long way', 'long ago', 'long before' and 'long-haired'. Turning it up made the model write more about long periods of time, so it seems tied to the idea of duration.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   of the pelvic floor and the muscles that support the bladder neck and vagina and give these organs tone and strength. A strong healthy set of pelvic floor muscles goes a long way to preventing urinary stress incontinence and pelvic floor prolapse.⏎There is

2. #2 peak

   still farmland back then, a good six miles north of teeming downtown and this was long before public transit. Maps of New York City as late as 184

3. #3 peak

   this important message!<|endoftext|>Forty-eight years ago, an event occurred that shattered the American psyche and permanently altered society as we know it.⏎The Beatles, a long-haired quartet from Liverpool, England, appeared on the Ed Sullivan show in New

4. #4 peak

   dwelling houses and field systems. This was in days when there were still wolves in the British Isles, long before the Romans introduced rabbits and horse chestnut trees and in a time when there

5. #5 peak

   more premature deaths each year than automobile accidents, which was long considered the leading cause. According to the study, particulate air pollution causes at

6. #6 peak

   necessary context for understanding. But it’s the strange bits of information that can really capture a person’s curiosity and help us relate to the people that lived long ago. They’re also the most fun things to share with our guests and get

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   order to resolve the dispute without the use of force. The rebels, who hail from the autonomous island province of Sulu in the southwestern Philippines, had been given until midnight on Tuesday

2. #2 peak

   ), Part 4, Chapter 7, eBook.<|endoftext|>Transcript for A New Horizon, segment 05 of 13⏎The Eastern

3. #3 peak

   an infected tick. Discover the latest research on babesiosis here.⏎Transcriptional analysis of p30 major outer membrane protein genes of Ehrlichia

4. #4 peak

   1–2. Sign up to view the full content.⏎This preview has intentionally blurred sections. Sign up to view the full version.View Full Document⏎Unformatted text preview: 60 | | | | CHAPTER 1 FUNCTIONS AND MODELS

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.