'and' joining two actions

What this neuron does

This neuron fires on the word 'and' when it links two actions in a row, like 'packed up our gear and selected food'. Turning it up made the model produce repeated filler words, so the steering does not clearly show this role.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Albemarle County was subsequently enlarged, and in 1696 the area south of Albemarle Sound was removed from Albemarle and made into a new county, named Bath

2. #2 peak

   own language. By the 8th century, the Cham script had outgrown Sanskrit and the Cham language was in full use. Most preserved manuscripts focus on religious rituals,

3. #3 peak

   potential gentrification that often comes with neighborhood investment in disadvantaged communities.⏎The Urban Green<|endoftext|>Every winter, California newts leave the safety of their forest burrows and travel as far as three miles to mate in the pond where they were born.

4. #4 peak

   surface-to-air missile.⏎Powers released his parachute and floated down to the surface where he was detained by KGB agents and interrogated

5. #5 peak

   thousands of Japanese American internees. One of the first families to arrive was the Wakatsukis, who were ordered to leave their fishing business in Long Beach and take with them only the belongings they could carry. For Jeanne Wakatsuki

6. #6 peak

   are off limits (unless a dieter chooses to put the risk of severe foodborne illness aside and eat raw meat). For this reason, the raw food diet typically resembles a vegan

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   up to 100 times faster than Map Reduce for iterative algorithms or interactive data mining.⏎- Learn how it provides in-memory cluster computing for lightning fast speed and supports Java, Python, R, and Scala APIs for ease of development.⏎-

2. #2 peak

   Germany occurred in 1966, but it was the oil crisis of 1973/74 that ended the "economic miracle" once and for all. By the time Herbert Grünewald succeeded Kurt Hansen as Management Board

3. #3 peak

   pupils are taught and governed, are what it mainly embraces, and the teacher is successful in the Art of Teaching, who trains children to be symmetrically developed men and women, in a physical, intellectual and moral sense. Certain modes of procedure,

4. #4 peak

   transported soil from the mainland, tucking it into crevices on this otherwise barren rock in hopes of cultivating flowers and vegetables. For a few months in summer and early fall, the rock became a colorful garden in the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.