unclear: first pieces of split words

What this neuron does

It mostly lights up on the first chunk of a word that the model has to finish, such as 'par' in 'parmesan' or 'conce' in 'conceives'. It doesn't clearly respond to one topic, and turning it down or up produced repetitive or off-topic text.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ry: Saute broccoli florets with cooked quinoa, garlic, ginger, and soy sauce for a protein-packed and satisfying meal.⏎- Roasted broccoli with parmesan cheese: Toss broccoli flo

2. #2 peak

   rets with olive oil, garlic, and parmesan cheese and roast in the oven for a crispy and flavorful side dish.⏎

3. #3 peak

   'Avola has spread to nearby cities (Noto, Rosolini, Pachino, Ispica and Victoria) to affect areas of the province of Caltanissetta and Trapani (1968).⏎Prior to

4. #4 peak

   , East Java; a green fashion show in Korea; and a project aimed at developing smart grid systems in Vietnam.⏎Young leaders can make a difference⏎Siti Nur Alliah, a British Council Climate Champion from Indonesia, is tackling a burning issue

5. #5 peak

   of Mines, Golden, Colorado 1979:43 pages⏎Dust control techniques in coal mines were investigated to perfect methods of generating monodisperse coal dust, develop methods for directly measuring supersaturation, make improvements in

6. #6 peak

   jaw that surround the roots of the teeth.⏎The curving part of the jaw into which the teeth are rooted.⏎The socket in the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   the Peace Corps. He created the Foundation Heart Ventures-Grupo de Ap<|endoftext|>is an elementary subatomic particle with infinitesimal mass⏎(less than

2. #2 peak

   out night patrols.⏎Ten Nieuport 80s went to Brazil in November 1918, where they were used by the Escola de Aviacao Militar at Campos dos Afonsos. Brazil also received a number

3. #3 peak

   8, in the Nihon Shoki 日本書紀 (720) 9 and in the Hizen-no-kuni fudoki 肥前國風土記 (first part of the 8th century)

4. #4 peak

   bu Anne mau makan di KFC.⏎Harimau tidak mau berlari ke rumah.⏎Perempuan muntah pohon.⏎Students

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.