unclear: first pieces of split words

What this neuron does

It seems to switch on at the start of a word that gets cut into pieces, such as 'Mo' in Moist or 'Wood' in Woodrow. The pattern is loose and the turned-up and turned-down outputs did not show a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   rescens (T.& G.) A. Gray. Nutlets slightly wrinkled or pebbly; plants 0.5-3 m tall⏎Moist to mesic meadows, ditches, streambanks, grasslands,

2. #2 peak

   the first permanent settlement in Carolina. They then divided the new county into four precincts: Currituck , Perquimans , Pasquotank , and Chowan . Albemarle County was subsequently enlarged, and in 16

3. #3 peak

   practice the alphabet as they travel from letter to letter in the maze. An open area at the front with toddler<|endoftext|>Mental Health and Wellbeing for Students⏎Moat gives students a platform in which to

4. #4 peak

   for design projects. Projects are developed from concepts learned in Wood and Metal Design, Interior Design and/or Intro to Architecture. New technologies such as

5. #5 peak

   sources to change U.S. law. Learn what you can do about bad decisions.<|endoftext|>8.75" by 5.5"⏎Wood, Paper, Leather⏎19th Century Culture; Religious Beliefs; Native

6. #6 peak

   often."⏎At the beginning of the program, 41 percent of students reported experiencing bullying, while 34 percent did so after the two-month program.⏎Moises Prospero, a Utah research consultant on criminal and social justice issues with a

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ⏎horizontally for 1 - 5 mm before bending up or curling downward. This⏎curling tendency produces the characteristic tangled branches. Branches⏎coarser below (1.5 mm diam.) more slender above (0.2

2. #2 peak

   ama (a tuber also known as sengkwang, yam bean, singkamas, Mexican turnip), amaranth (also called pigweeds) and mucuma (a tropical legume). “Milpa crops are

3. #3 peak

   acids in the dough, and the final, hottest process called caramelization. But watch the video to get the whole, fun story!⏎Dig Deeper, Get Sweeter⏎As with all TED ED lessons, there are links for those with a

4. #4 peak

   word meaning simply “box.” This ark, on the other hand, is represented by a Hebrew word meaning “chest” or “coffin.” It was first used in Genesis 50:26,

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.