hyphen inside a compound word

What this neuron does

This neuron lights up on the hyphen in words joined by a dash, like Self-Reflection or Coal-to-liquid. Turning it down made the model produce run-on strings of words without spaces, and turning it up made it repeat small words like 'the'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   roversial Qeiyafa Comes to U.S. Museum<|endoftext|>An Argumentative Essay about Mary Oliver’s Poems: Exploring the Power of Nature and Self-Reflection

2. #2 peak

   were all based on Earth and planetary cycles, most had a spring goddess. The spring goddess in Scandinavian was "Ostra," for Anglo-Saxons it was "Eostre," and the current region of Germany she was called "Eastre

3. #3 peak

   be even easier to use. Do you live in or near a Cool City? Check the site now to find out.⏎The Worst Alternative Fuel Ever?⏎Coal-to-liquid fuel has

4. #4 peak

   the documents are surrounded by an inert gas. A cross-section of these cases can be seen in the “Public Vaults,” along with a special documentary about the re-encasement process.⏎This brochure is made possible by the National Archives Foundation with

5. #5 peak

   05, 2012, from http://www.studymode.com/essays/The-Struggle-For-Power-In-The-994323.html⏎"The Struggle for Power in the U

6. #6 peak

   /essays/The-Struggle-For-Power-In-The-994323.html>.⏎"The Struggle for Power in the U

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   in the Trans-Pecos. Current evidence indicates that mountain lions (Felis concolor), bobcats (Lynx rufus), and coyotes (Canis latrans) are the primary predators involved, although little information is available

2. #2 peak

   :⏎Fifty-eight mammal species have been reported in the park to date such as:⏎- Tiger (Panthera Tigris),⏎- Clouded Leopard (Neofelis nebulosa),⏎- Swamp Deer (Cervus du

3. #3 peak

   how many exist.⏎These tentacled titans have now ensnared marine biologists with⏎another riddle: they have left their normal gathering grounds in⏎the Sea of Cortez in Baja California, Mexico. Fishermen worry that

4. #4 peak

   when using the bathroom, particularly shigella (a foodborne bacteria that causes diarrhea, fever, and stomach cramps) and norovirus (often called "stomach flu" which also causes nausea, vomiting, stomach cramps,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.