unclear: mid-phrase words across many languages

What this neuron does

This neuron fires on a random assortment of words in the middle of a phrase, in many languages, with no clear shared meaning. Turning it up or down changed the text the model wrote in unrelated ways, often switching languages.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   turning off lights).⏎We appreciate the efforts of the contributors to this special issue who are addressing some of<|endoftext|>L’Encyclopédie de l’histoire du Québec / The Quebec History Encyclopedia⏎Ethics and Morals of the Indians of

2. #2 peak

   88: περιγράφει τετράγωνον σχῆμα τῷ λόφῳ in Einklang zu bringen, ist es unumgänglich no

3. #3 peak

   en and Plan du Havre de Noel, dans la Terre de Kerguelen, as well as an inset at bottom left showing two

4. #4 peak

   de Doopsgezinde Gemeente to Amsterdam, 2 vols. Amsterdam: Uitgegeven en ten geschenke aangeboden door den Kerkeraad dier Gemeente, 1883-

5. #5 peak

   Is.⏎|Prepared by:||Gordon Rudloff⏎Ohio Department of Agriculture<|endoftext|>Logic & ProofsOpen Learning Initiative⏎Cosa impari in questo corso?⏎Logic & Pro

6. #6 peak

   these prepositions must be in accusative case: durch-throughfuer-for gegen-againstohne-without um-around Er kauft das Geschenk fuer mich.<|endoftext|>In case you are searching for easy Preschool Activities, you can

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   O snap/ring gauges (for checking shafts) and plug gauges (for

2. #2 peak

   der Zijpp|⏎<|endoftext|>The Great Pacific Garbage Patch may qualify as the largest garbage

3. #3 peak

   04)⏎(4) « La compression veineuse est le traitement de base des affections ve<|endoftext|>With concern over

4. #4 peak

   Antalya-Türkiye’de doğdu. Lisans öğrenimini MSÜ Deniz Harp Okulunda tamamlamıştır.⏎

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.