unclear: word before an event or name

What this neuron does

The snippets are mixed: it fires on words in history-style sentences, like 'in' after 'died' or 'World' before 'War', where a name or event often comes next. Turning it up made the model output the single word 'a' over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   romatography<|endoftext|>President Manuel Zelaya and his opponents now in charge in Honduras remain in a standoff. Inside the country, supporters of both sides are waging mass protests, while concerns continue regarding media censorship. This crisis provides an opportunity to

2. #2 peak

   the leading figure of the artistic school called Neo-Classicism. Born in Paris, he was deserted by his mother at age 9 after his father had been killed in a duel. Raised by uncles, he enrolled at age seventeen in the Royal

3. #3 peak

   Indian groups throughout the Pacific Northwest, including the Nez Perce, Umatilla and Yakama.⏎Within months, hostilities broke out, now known as the Battle of Frenchtown (also known as the Battle of Wall

4. #4 peak

   🇱 It is worth noting that the Indian contribution to victory in the First World War in the Middle Eastern area was also noted on one of the 4 stamps

5. #5 peak

   Palm Oil Board (MPOB),⏎6 Persiaran Institusi, Bandar Baru Bangi,⏎43000 Kajang, Selangor, Malaysia.<|endoftext|>Available for download after purchase.⏎This book is designed to

6. #6 peak

   example sentence"⏎- S: (n) fire (the event of something burning (often destructive)) "they lost everything in the fire"⏎- S: (n) fire, firing (the act of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   .<|endoftext|>Published 4th February 2021Pre-order⏎In 1863, the US Civil War was raging. Abraham Lincoln’s Emancipation Proclamation had freed over

2. #2 peak

   of freedom, protection and pay.⏎Additional Details from our Exhibits and Publications:⏎“And retaliation will be our practice now . . .”⏎After President Lincoln issued the Emancipation Proclamation on January 1, 1863, the

3. #3 peak

   Ice Age that took place long ago.⏎Such an Ice Age is foretold to take place again right before the final battle:"Then will come the second Fimbulwinter. Snow will drive in from all directions; the cold will be severe

4. #4 peak

   we were introduced to the primal ice first, and so it is when the worlds are to be destroyed, at least in a sense. This is the second Fimbulwinter, where the elements themselves begin to turn against the divine order and rip

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.