word-start fragments mid-word

What this neuron does

This neuron fires on the opening piece of a longer word or name that is cut into several tokens, like "Ger" in Gerstenmaier, "Car" in Carole, or "sc" in scorpions. The pattern is broad and not limited to names. Steering did not produce a clear theme: turning it up gave loose, rambling text and turning it down gave repetitive text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   some extra time to make a decision. It now hopes to make a launch decision on Monday morning.⏎“We have really two competing objectives,” says NASA associate administrator Bill Gerstenmaier. “One, we want to get the vehicle ready to go

2. #2 peak

   ners⏎- Visual Supports, Core Words, and Martin Luther King⏎- Core Values: Suggestions for Language Building with AAC Learners⏎This post was written by Carole Zangari<|endoftext|>Australia ranked in the middle of the pack in the recent

3. #3 peak

   of Text Reinterpretation Skill.⏎Bonitatibus, Gary; Beal, Carole R.⏎Four studies investigated when children became able to detect that the words of

4. #4 peak

   largest consumer of cocaine and has been leading efforts to eradicate coca production in the Andes for decades.⏎Bolivia is the world's

5. #5 peak

   a self bailer, a whistle and bow/stern line. It is also a good idea to be prepared with rescue ropes, throw lines, a knife and carabineers.⏎Dress properly for an unexpected cold-water swim and changing weather

6. #6 peak

   Community. So, what are a few of the events that you should definitely attend? There’s the Wild World of Animals that features 14 interesting animals—from scorpions to legless lizards—sponsored by N.A.T.U.R

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   aramidia, along the western shores of the great seaway that separated North America; this landmass hosted a vast array of unique dinosaur species and served as the crucible of evolution for iconic dinosaur groups such as the horn

2. #2 peak

   erger developed a safety coffin in 1829 that had bell strings attached to both arms and legs of the corpse.⏎In modern times Fabrizio Caselli designed a safety coffin with an emergency alarm, intercom, a light,

3. #3 peak

   ad region began demanding independence from the southern, Bamako-based government. After forcing the Malian military from the north, however, the separatist forces soon became embroiled in a conflict of their own, between the original Mouvement National pour

4. #4 peak

   1882. But his absence did little to⏎resolve the theological divide and soon after his return he became embroiled⏎in fresh controversy over his failure to denounce⏎George Higin

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.