unclear: word pieces in names and foreign text

What this neuron does

This neuron fires on fragments in the middle of names and words, often in Dutch, German, Latvian or Greek text. There is no clear pattern beyond that, and turning it up or down did not change the writing in an obvious way.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Houdini’s career led him to collaborate with Scientific American on a lengthy exposé of

2. #2 peak

   ukken berustende bij de Vereenigde Doopsgezinde Gemeente to Amsterdam, 2 vols. Amsterdam: Uitgegeven en ten geschenke aangeboden door den Kerkeraad d

3. #3 peak

   Um dies (i.e. Varro's description of the extent of Roma quadrata) mit dem unten erörterten Pomerium und der Auffassung des Dionys. I 88: περιγρ

4. #4 peak

   products. In the spring of 1934, the Franks r…⏎E-pasta adrese, uz kuru nosūtīt darba saiti:⏎Saite uz darbu:

5. #5 peak

   ἔλεγεν αὐτοῖς,⏎τὸ σάββατο

6. #6 peak

   This is the most obvious similarity between the two religions. In fact a Muslim is defined as anyone who says "Th…⏎E-pasta adrese, uz kuru nosūtī

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   bill to establish a federal holiday in 1894. President Grover Cleveland signed the bill soon afterward, designating the first Monday in September as Labor Day.⏎Learners are Leaders, Inc.’s mission includes uplifting future leaders through

2. #2 peak

   trade unions was given further impetus in the freedom struggle against British colonialism. One of the earliest trade unions, Tata Workers Union (also alternatively known as Jamshedpur’s Workers’ Union) (http://www.tataworkersunion.org/)

3. #3 peak

   ⏎Principal researcher: Reyhaneh Bastani⏎Supervisor: Dr. Beaumie Kim⏎P

4. #4 peak

   of 1857. He is known for his efforts to modernize his country and for restoring Mexico to a Republic.⏎May 1st: Labor Day, commemorates the union movement of the Mexican worker. Article 123

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.