unclear: word fragments in foreign text

What this neuron does

This neuron fires on pieces of longer words in non-English text, such as the middle of a Swedish or Persian word, and it is hard to say what they have in common. Turning it up made the model repeat itself or drift into Chinese characters, so it does not show a clear job.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   to increase, which is a growing public health concern.⏎|Status||Published - 2014 jan. 1|⏎- Folkhälsovetenskap, global hälsa, socialmedicin och epidemiologi<|endoftext|>Russia can

2. #2 peak

   : Madison McDermott⏎The Green New Deal Federal Resolution was introduced in 2019 by Rep. Ocasio-Cortez and Sen. Ed Markey as a plan to tackle a trifecta of crises: the climate

3. #3 peak

   .⏎2 پژوهشگر دوره تخصصی دکتری معماری منظر، دانشکده معماری و شهرسازی، دانش

4. #4 peak

   a representation of both the classes whereas TEU consists of officers only. Though<|endoftext|>نوع مقاله : مقاله پژوهشی⏎1 دانشیار معماری، دانشکده معماری

5. #5 peak

   Pine Ridge, he advocated for peace with the European Americans⏎Date de dernière mise à jour : 05/07/2021⏎Ajouter un commentaire<|endoftext|>By DANIEL SUDDEATH⏎NEW ALBANY —

6. #6 peak

   uffassung des Dionys. I 88: περιγράφει τετράγωνον σχῆμα τῷ λόφῳ in Einklang zu bringen

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   and 2014, World Bank says. Wealth remains unequal, and some countries are falling behind.⏎El Banco Mundial analiza la riqueza de los países, tomando en cuenta no solo el PIB, sino también el

2. #2 peak

   research on BPA. Glass bottles, however, also leach chemicals, including aluminum, explains a study by Clemens Reimann of the Norges Geologiske Undersøkelse in Norway and colleagues. Aluminum is sometimes added to

3. #3 peak

   ) право голосовать⏎2. Прочитайте текст Mayor-Council и заполните пропуски текста словами и выражениями, данными в

4. #4 peak

   ⏎1. Соотнесите значения слов и выражений, данных в левой колонке, с их английскими эквивалентами, данными в правой колонке⏎1) legislative branch a) Член

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.