unclear: mixed, end-of-text and function words

What this neuron does

This neuron fires on a grab bag of spots: the end of a document, words like 'from', 'which' and 'could', and ordinary places in sentences. No single theme stands out. When pushed up, the model's writing turned repetitive and wandered toward generic phrases, but that doesn't point to a clear meaning.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   were based on NASA’s lunar architecture plans.⏎The game itself only takes around 20 minutes to play, and despite its sophisticated 3D visuals—the game<|endoftext|>Disk or partition alignment is something new to me. I have heard of it before

2. #2 peak

   for which mankind are warranted, individually or collectively in interfering with the liberty of action of any of their number, is self-protection. That the only purpose for which power can be rightfully exercised over

3. #3 peak

   of Publication⏎Blanks, C. M. (1948). San Antonio the Inland Gate. Retrieved from https://digitalcommons.pvamu.edu/pvamu-theses/39

4. #4 peak

   insects in their diet. Further down the line, he hopes these mini-cricket factories will catch on as a sustainable local food source for North American cities. "<|endoftext|>Philadelphia is the largest city in the Commonwealth of Pennsylvania, the second largest city on

5. #5 peak

   $50 from the mint."<|endoftext|>In the next of our blog posts for Census week, we showcase recent research undertaken

6. #6 peak

   than €1 each to produce. 10 confirmed patients have been connected to a breathing machine via a 3D printed valve.⏎Although Fracassi is<|endoftext|>Key: "S:" = Show Synset (semantic) relations, "W

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   or not and take the default route. Here’s an example of⏎mwhen for Monoids:⏎-- Important numbers!⏎xs = [6, 9, 13,

2. #2 peak

   , this function is only declared as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++.⏎/* memchr example */⏎int main ()⏎char * pch;⏎char str = "

3. #3 peak

   Ones. For this deed, she went down in Assassin history as the legendary Egyptian Assassin who killed Cleopatra with an asp.⏎- 1 Biography⏎- 2 Legacy⏎- 3 Personality and traits⏎- 4 Behind the

4. #4 peak

   with <BODY> and end with </BODY>, but in practice this isn't essential. The

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.