pieces inside split or hyphenated words

What this neuron does

This neuron fires on the middle pieces of words that the tokenizer has broken apart, such as 'zer' in Weezer or 'ed' in 'domed', and on hyphenated links like 'one-and-a-half'. It goes strongly negative on the middle word of 'case-by-case' and 'day-to-day'. Turning it up did not produce a clear change in the writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   yura⏎- The Crab Movie, (2010)⏎- Attack of the Crab Monsters (1957)⏎- Crab, by Weezer⏎- The Crab Song, by Faith No More⏎- Crazy Joe, from

2. #2 peak

   will ask you to walk on our treadmill for up to 15 minutes. You are free to rest at any time. The whole process may take between one and two hours.⏎What is the most important piece of technology used in the

3. #3 peak

   these in the ground and they will rot away)⏎- plastic containers – these also are takeout containers from a deli and they have the bonus of a domed clear plastic lid

4. #4 peak

   , and joining the three zones of the canvas: the still life of melons and leaves on a gridded pavement, bottom left; the architecture with domed marabout, top left; and the figures, at right. Next to a

5. #5 peak

   Auschwitz-Birkenau extermination camp, the last extermination center still functioning under the Nazis. They found 7,650 survivors. Some one-and-a-half million people were murdered there, including 960,00

6. #6 peak

   .), W: 8 7/8 in. (22.5 cm.)|⏎|Location||Alte Pinakothek, Bayerische Staatsgemä

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   .⏎Different elements have different melting points, so furnace temperatures are adjusted on a case-by-case basis.⏎In metal parts manufacturing, melting is used for casting -- where the

2. #2 peak

   to predict what the teacher has written! When they have finished writing their sentence, they stand up. Once all are standing, you begin to read your sentence word by word. Ask them to sit down as soon as one of their words is not

3. #3 peak

   , let’s start off with a simple question: What is TVOC?⏎Air pollution is an “invisible threat” that most people don’t consider in their day-to-day lives, yet it is an issue that affects people around the world in substantial

4. #4 peak

   their decision making and strategic planning.⏎• Systematically assess the financial viability of their functions, plans and projects.⏎• Manage and control their budget effectively on a day-to-day basis.⏎Introduction, Course outline, Expectations and Takeaways⏎• Understanding

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.