'the' after words like 'underscores'

What this neuron does

This neuron lights up on the word 'the' right after verbs like 'underscores', 'emphasizes' or 'highlights', where the next word is likely to be 'importance' or 'need'. When it was turned up, the model kept producing 'the importance of the' over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   in 2013 was 25 percent, or 13 percentage points below the state average. This means that after decades of being told about the need to recycle, we are one-third of the way to a goal we

2. #2 peak

   children’s range of movement has shrunk over the decades and nowadays a child does not necessarily leave the house or its yard without the company of parents. This emphasizes the importance of the immediate environment from the front door.⏎With planning, we want to

3. #3 peak

   mismatched interfaces. Layer inclination further influences stress fields, shifting the location of maximum stress concentration over varying distances. This study underscores the significance of accurately understanding mechanical properties, layer dip in volcanoes, and magma chamber

4. #4 peak

   financial and social burden of NCDs will grow dramatically in the next years. The results highlight the need for interventions to address behavioral changes, including reduction in smoking, improvement of dietary

5. #5 peak

   his professional and personal lives collided when he was ordered to evacuate his home in the middle of the night to escape a spreading wildfire. Lempert's experience emphasized the challenges of adapting to climate change, “not merely because it is hard, but

6. #6 peak

   drought and floods, underscoring the connections between climate and people,” this article says. Yet the extensive civilization at Ang

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   1925–1926.⏎[I’m a big fan of the excavation technique reproduced here.]⏎[Legalized pot hunting is more to the point.]⏎I’ve recently come under fire, again, for

2. #2 peak

   , thematic survey of the history of science from its roots in different cultures around the world through to the present day. He explores crucial milestones in scientific development and at the same time examines the enormous social and intellectual changes they initiated. Opening with a discussion

3. #3 peak

   computers connected to any network in the set. With the Internet, many remote computers can communicate.⏎Networks in Everyday Life⏎Extensive use of networks is on the business side. Networks are used for advertising, production, posting, editing, payment

4. #4 peak

   understandable. Gravitational waves are minuscule — the atomic jitters that pass through our world when two black holes bash together in a distant galaxy are on the order of a billionth of a billionth the diameter of an atom. L

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.