pieces of words split into fragments

What this neuron does

This neuron fires on a small piece in the middle of a longer word that the model has split into parts, such as 'Jant' in 'Jantzen' or 'at' in 'insatiable'. Mostly it shows up in names and uncommon words. Turning it up did not produce a clear theme in the written text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   in gene activity among individuals can give powerful clues for diagnosis, prognosis and intervention of different diseases. Senior author Emmanouil Dermitzakis, Louis Jeantet Professor at UNIGE, who led the study, emphasizes that today’s

2. #2 peak

   30,000 guilders. During this period David Penner was a minister of the church of Bagdannen, whereas Salomon Jantzen seems to have been a deacon. The members of this Lithuanian

3. #3 peak

   . The Art of Slow Reading. Portsmouth, NH: Heinamann, 2012.⏎And advocate to taking one’s time to

4. #4 peak

   23, 2011⏎When two galaxies merge to form a giant, the central supermassive black hole in the new galaxy develops an insatiable appetite. However, this ferocious appetite is unsustainable.⏎The growth of super

5. #5 peak

   of 1934, the Franks r…⏎E-pasta adrese, uz kuru nosūtīt darba saiti:⏎Saite uz darbu:<|endoftext|>Branch of biology that groups and names organisms based on studies

6. #6 peak

   dharma of another. Nothing is ever lost in following one’s own dharma. But competition in another’s dharma breeds fear and insecurity.”⏎The word janma translates as “birth”. Ashtami (ush-tum-me) is the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , pickled pigs feet, lutfisk or dried codfish and variety of sweets.⏎A popular Christmas tradition is to

2. #2 peak

   unkel⏎starring Jim Witter,⏎featuring Ian Tanner⏎“Time it was, and what a time it

3. #3 peak

   land.⏎The cut comes into effect on December 19 and will apply across England and Wales.⏎According to Defra over 70% of the nitrates in Britain’s waterways can be traced back to agriculture. They cause twin

4. #4 peak

   water contaminants discovered by water testing labs.⏎Nitrates are routinely discovered in tainted water supplies because they’re so prevalent in the environment. The primary source of nitrates in the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.