'the' after across, around or of

What this neuron does

This neuron fires on the word "the" in phrases about wide places or whole groups, like "around the world", "across the country" or "and the elderly". Turning it up made the model repeat simple sentences about the sun and weather, which is only loosely related.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   drives. But IBM’s ideas still rely on the use of a magnetic field to store that data.⏎Researchers from around the world are collaborating on solving the speed problem, and they’ve come up with a

2. #2 peak

   ers during the French religious wars, Mercier was obliged to take refuge in Venice in 1567 and, after returning to France, he died of the plague. One of his best-known works was the Libellus de abbrevi

3. #3 peak

   confusing, punctuation marks.⏎From Afghanistan to Zimbabwe, discover surprising and intriguing language facts from around the globe.⏎The definitions of ‘buddy’ and ‘bro’ in the O

4. #4 peak

   can be mixed. This could be because of already mentioned approximate land type detection. In<|endoftext|>Nutrition plays a very important role in the lives of both young and old. However for seniors, it’s important to be aware of new studies on how

5. #5 peak

   the article.⏎The latest study followed a group of nuns, monks and priests from across the United States over a period of 12 years. They were chosen as a

6. #6 peak

   those who experience it. Unfortunately, despite efforts to raise awareness and implement preventative measures, instances of sexual harassment continue to occur in schools, colleges, and universities across the country.⏎In Pakistan, schools, colleges, and universities are considered to be safe

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Whooper,"<|endoftext|>AttachmentsAccessible Version Accessible version of the tutorial content in PDF format⏎Source and Access Information⏎Aligned StandardsThis vetted resource aligns to concepts or skills in these benchmarks.⏎In this interactive tutorial, learn about the major factors

2. #2 peak

   listen to and obey His voice⏎Jeremiah 7:28 "And you shall say to them, 'This is the nation that did not obey the voice of the LORD their God or accept correction; truth has perished and has been

3. #3 peak

   at Mount Sinai when G-d descended upon the mountain and gave us His Torah. As it says: “Only beware and guard yourself carefully, lest you forget the things your eyes have seen and lest they stray from your heart all the days of your

4. #4 peak

   great joy that will be for all the people. 11 For unto you is born this day in the city of David a Savior, who is Christ the Lord. 12 And this

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.