the letter d inside words

What this neuron does

This neuron lights up on the letter d when it starts a word piece, like the d in dim, dementia, ditches or dimes. When it was turned up, the model's replies got stuck repeating filler words such as 'about about about', which does not clearly relate to the d pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ME.⏎DIM is traced to Old Norse dimmr (dark) andIEbasedhem (smoky). Russian smoke is dim; in⏎Turkish it is duman.⏎Edenic covers the silence and senselessness of DUMB. דמי

2. #2 peak

   of all the different types of dementia (including younger-onset dementias), from the most-recognized - Alzheimer's - to the less-f

3. #3 peak

   high on inside fence, and well-preserved section of ditch c 3m below rampart. On the SW and SE sides the defences consist of twin ditches with a medial rampart. The ditches are slight and on the SW

4. #4 peak

   Accusative Nominative Accusative ichmich dudich erihnsiees wiruns ihreuchsie/Sie⏎Pre

5. #5 peak

   όφῳ in Einklang zu bringen, ist es unumgänglich nothwendig dass der Ausdruck Roma quadrata technisch in doppeltem Sinne gebraucht wurde; einmal zur Be

6. #6 peak

   700 pounds. Mechanical fastening is difficult because of a tendency for splitting. Predrilling for nails and screws is advisable.⏎Drying. The wood dries slowly with some risk of checking, end splitting, and warping. Slow

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   sons. He loved them very much. They always used to help one another<|endoftext|>Ramses III, Ramses also spelled Ramesses or Rameses (died 1156 bce, Thebes, Egypt), king of

2. #2 peak

   trigger.” 26 U.S.C. § 5845(b). The machine gun was first widely used during World War I, where it “demonstrated its murderously effective firepower over and over again.” William Rosenau

3. #3 peak

   with a specialist, rural emergency room physicians are more likely to adjust diagnosis and course of treatment for injured children, research shows.⏎The use of technology to link far-distant practitioners

4. #4 peak

   combination of employer and employee contributions and offer a range of options, including Health Maintenance Organizations (HMOs), Preferred Provider Organizations (PPOs), and High-Deductible Health Plans (HDHPs

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.