the word 'people' coming next

What this neuron does

This neuron seems to be about predicting the word 'people'. Its strongest negative examples sit right before 'people' or 'most of us' or 'million people', and turning it up made the model repeat 'people' endlessly. The positive examples are weak and show no clear shared pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   fiber optic cable.⏎As SpaceX works to expand its capacity for more and more customers and geographies, it necessitates that they build more ground stations to collect the Starlink signals. But what do these earth stations look like? Reddit user 'and

2. #2 peak

   North American continent.⏎Rising prominently at 5,895 m (19, 341 ft) in north-eastern Tanzania, the snow

3. #3 peak

   Day, which commemorates the Virginia General Assembly’s approval of Thomas Jefferson’s historic Virginia Statute for Religious Freedom, a precursor to the religious liberty protections in the First Amendment to the U.S. Constitution.⏎In this year’s Religious Freedom Day proclamation

4. #4 peak

   similar entity; an Indian tribe or an authorized Indian tribal organization; or a designated and approved management agency under section 208 of the Clean Water Act that discharges to waters of the United States.⏎- Designed or used for collecting or conveying

5. #5 peak

   . The Federal government moved them to the Brazos Indian Reservation in 1855 and later to Oklahoma.⏎The Cherokee, Delaware, Shawnee, and Kickapoo Native American people began settling in the area circa 1820

6. #6 peak

   the most southerly science research station operated by the British Antarctic Survey (BAS) and is located on the 150-metre thick floating Brunt Ice Shelf, which moves 400 metres per annum towards the sea.

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   down (type 1), or can’t effectively use the little insulin that it does produce (type 2).⏎First, to understand what happens in the bodies of people who have diabetes, you should know what happens in the bodies of people who

2. #2 peak

   , lonely or frustrated.⏎It's important to remember it is OK to feel this way and that everyone reacts differently. Remember, this situation is temporary and, for most of us, these difficult feelings will pass.⏎Exercise should be a regular part of

3. #3 peak

   is not improved by medication or therapy.⏎Share this article⏎Depression is one of the most common forms of mental illness, affecting more than 350 million people worldwide, according to a Reuters video. Bob Holmes is one of them.

4. #4 peak

   associated with Alzheimer's disease?⏎Answer: So, the memory changes of Alzheimer's disease represent a change for that person in terms of forgetfulness. Of course, some of us are absent minded all of our lives, but if we have an increased

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.