unclear: word fragments across languages

What this neuron does

This neuron fires on partial word pieces in many languages, such as Russian, Finnish and Persian, often in the middle of a word. Its pattern is not clear, and turning it up produced garbled, repeated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   евой колонке, с их английскими эквивалентами, данными в правой колонке⏎1) legislative branch a) Член Верховного Суда⏎2) civil and criminal cases b)

2. #2 peak

   techniques and processes that were developed *before* the idea of genetic engineering which is the biochemical creation of specific advantageous mutations in the genome of a plant. Before the advent of GMO farmers and plant breeders had to wait for nature to create a natural

3. #3 peak

   yväislinkit|⏎|Tila||Julkaistu - 1 syysk. 2021|⏎|OKM-julkaisutyyppi||A1 Julkaistu artikkeli, so

4. #4 peak

   it. What this implies is that caffeine is doing something to your internal brain chemistry to make this happen – and where there’s neurochemistry, there’s a ton of crazy internal mechanisms that actually make that effect happen.⏎One can easily and efficiently

5. #5 peak

   and the Zoological Society of London’s Institute of Zoology and published this week in the journal Nature Communications⏎The African straw-coloured fruit bat (Eidolon helv

6. #6 peak

   garrot, gowdy, pied widgeon, whiteside, curre, and doucker. Barrow's golden-eye of America (Glaucionetta Islandica) is

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   (i.e. Varro's description of the extent of Roma quadrata) mit dem unten erörterten Pomerium und der Auffassung des Dionys. I 88: περιγράφ

2. #2 peak

   Antalya-Türkiye’de doğdu. Lisans öğrenimini MSÜ Deniz Harp Okulunda tamamlamıştır.⏎Yüksek Lisans Öğrenim

3. #3 peak

   ментарии при наличии в них нецензурной брани, оскорблений или спама<|endoftext|>Conflict and Solid

4. #4 peak

   их английскими эквивалентами, данными в правой колонке⏎1) legislative branch a) Член Верховного Суда⏎2) civil and criminal cases b) окружной суд⏎3

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.