word fragments inside non-English words

What this neuron does

This neuron fires on a short piece in the middle of a word from another language, such as 'nos' in a Latvian word or 'als' in a Polish name. Its values are small and mixed, and turning it up did not give a clear pattern in the writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   products. In the spring of 1934, the Franks r…⏎E-pasta adrese, uz kuru nosūtīt darba saiti:⏎Saite uz darbu:<|endoftext|>

2. #2 peak

   is the most obvious similarity between the two religions. In fact a Muslim is defined as anyone who says "Th…⏎E-pasta adrese, uz kuru nosūtī

3. #3 peak

   ons of the Prussian King Friedrich Wilhelm I, who finally expelled them from the district. The [[Amsterdam Mennonite Library (Bibliotheek en Archief van de Vereenigde Doopsgezinde Gemeente te

4. #4 peak

   inct in the Wild until 2008, but since a series of reintroductions, have developed free ranging populations in the wild. All Przewalski’s horses alive today are descendent of 14 individuals from a captive

5. #5 peak

   established to guide players, and the people that coach them, through a level-appropriate system of basketball development. Using scientific guiding principles developed by coach educators Istvan Balyi and Richard Way, and found in their book Long-Term Athlete

6. #6 peak

   na in the wilderness (John 6:49-51).⏎Dragons still

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ментарии при наличии в них нецензурной брани, оскорблений или спама<|endoftext|>Conflict and Solidarity in Mudejar

2. #2 peak

   ЛЬНАЯ РАБОТА ПО АНГЛИЙСКОМУ ЯЗЫКУ⏎КО

3. #3 peak

   simple problem, one that a fifth grader may find in a math book. What about the problems we face in adulthood? (read more here)<|endoftext|>Задание от гостя:Размещено 13.09

4. #4 peak

   under the czar’s vicegerent in Warsaw. Rzewuski edited the government newspaper Dziennik warszawski.⏎WORKSDziela, vols. 1–6. Warsaw, 1877–8

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.