'age' or 'way' ending a word

What this neuron does

This neuron fires on the last piece of a longer word when it is 'age' or 'way', as in 'passageways', 'headway' and 'drainages'. It seems to recognise word endings that are split off as a separate piece. Turning it up did not change the topic of what the model wrote.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   early and late stage asthma⏎Normally on inhalation of allergens, the airway narrows and wheezing develops within minutes as the lungs swell and passageways narrow. The wheezing will start in about 10 minutes,

2. #2 peak

   people believe that the Pyramids are a link to an ancient lost civilization, and may still contain evidence to prove it. Many conspiracy theories regarding secret chambers and passageways within the pyramids exist to this day.⏎These conspiracy theories became even more

3. #3 peak

   territory of 1057 km2. It shares its neighborhood with India’s World Heritage site, Manas Tiger Reserve, and is also associated by passageways to Phibsoo Wildlife Sanctuary and Jigme Singye National Park

4. #4 peak

   |⏎|Day 4 – Spotting the Errors & Improving Sentences||3 hours||Essay Assessment|⏎|Day 5 – Grammar & Fixing Passages||3 hours||Complete Writing Exam|⏎How We Teach⏎For all aspects of

5. #5 peak

   common as he traces the history of instant communication from ancient times to today.⏎→ Event: Tom Standage | Barnes and Noble Wednesday 6pm | Information⏎Excerpt: Writing on

6. #6 peak

   on (just ask Joss Whedon or the Wachowski brothers or Dr. Octopus). So, it should be inevitable that companies start making headway towards bringing a revolutionary technology out of the hospitals and into the markets.⏎It’s

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   the primary problem lies with the heart muscle cells themselves; these diseases are called cardiomyopathies. Different cardiomyopathies are caused by different cellular defects, but most of the cardiomyopath

2. #2 peak

   deficits (myosin V), and cell division defects that may be linked to cancer (nonmuscle myosin II). In addition, inherited familial cardiomyopathies affecting 1 out of 500 people result from missense

3. #3 peak

   it.”⏎This is usually simplified as follows: small doses stimulate, medium doses inhibit and large doses kill. Thus the minimum, potentised dose is employed by homeopaths.⏎When seeing a homeopath for

4. #4 peak

   - Individuals who have congestive heart failure of any cause⏎- Individuals with intrinsic heart muscle disease such as hypertrophic cardiomyopathy, idiopathic dilated cardiomyopathy, and arrhythmogenic right ventricular dysplasia⏎- Individuals with

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.