word fragment inside a longer word

What this neuron does

This neuron fires on the first pieces of a word that has been split into parts, such as 'Kar' in 'Karate' or 'cycl' in 'cyclonic'. Turning it up sent the model into repeated 'way' and 'time' phrasing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   develop into the individual he or she is destined to be by virtue of their own efforts.⏎Pure Fun - Yoga Class⏎Practical Life learning⏎Pure Fun - Karate class⏎5 year old graduation<|endoftext|>Look at the egg⏎picture. Write

2. #2 peak

   uelen [and] Plan du Havre de Noel, dans la Terre de Kerguelen, by Rigobert Bonne, from Atlas Encyclopedique, circa 1787, (11.3

3. #3 peak

   time of the attack of Omer Pasha on Montenegro in 1862. At the end of the 19th century this building was Karuč school, managed by the teacher Mihajlo K. Popovic

4. #4 peak

   most widespread fabrics in the world. Oxford cloth is created by weaving together two yarns that are of the same color but just a shade different, giving it a marled texture that breaks from the ordinary aesthetic of a solid dress shirt.⏎Oxford

5. #5 peak

   storms that produce strong winds, rain, and storm surges. “Tropical cyclone” is a generic name that refers to the storms' geographic origin and cyclonic rotation around a central eye. Depending on their location and strength, the storms

6. #6 peak

   are more expedient (recycling, turning off lights).⏎We appreciate the efforts of the contributors to this special issue who are addressing some of<|endoftext|>L’Encyclopédie de l’histoire du Québec / The Quebec History Encyclopedia⏎Eth

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   exposure, whereas radiation-related health problems may often take up to a decade before symptoms develop.⏎(ARTICLE CONTINUES BELOW)⏎The researchers said that carrying out studies in Israel, where the level

2. #2 peak

   Capital News – Dec. 3, 2017);⏎- “Icy road leads to crash” (Castanet – Nov. 4, 2017)⏎Do you ever

3. #3 peak

   with the sacredness of the soul. Carolyn D. Williams (1993) examines Lucrece's rape, as well as the rape of Lavinia from Shakespeare's Titus Andronicus, and finds that Shakespeare's treatment

4. #4 peak

   ivian Army and the CIA in 1967 (Castaneda 1998, 326).⏎What Individuals Thought of

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.