'the' after a preposition or verb

What this neuron does

This neuron lights up on the word 'the' (or a similar word like 'combined') when it comes right after a preposition or verb, such as 'substitute for the', 'quality of the' or 'accountable for the'. It is waiting for a noun phrase to follow. Turning it up gave loosely connected, wandering text with no clear topic change.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   . ©2015 Walmart. All Rights Reserved.⏎Important Walmart Disclaimer: All content provided is for informational purposes only, and is not intended to substitute for the diagnosis, treatment, or advice of a medical professional. Consult your medical professional for

2. #2 peak

   provides information of a general nature and is designed for educational purposes only. If you have any concerns about your own health or the health of your child, you should always consult with a physician or other health care

3. #3 peak

   creative fountain design is important. Various types of sprinklers are widely used in waterscapes to generate various water shapes. At present, there are great differences in the quality of domestically produced nozzles. Compared with similar products abroad, the biggest

4. #4 peak

   2 billion all-time downloads. In the past 12 months, the app was downloaded almost three-quarters of a billion times, which is more than the combined downloads of Facebook, Instagram, and WhatsApp. It is currently in the crossh

5. #5 peak

   in a locked location separate from the firearm.⏎Child Access Prevention (CAP) laws go one step further by imposing criminal liability to ensure that owners are held accountable for the security of their weapons.⏎The US Congress should pass legislation requiring the safe and secure

6. #6 peak

   nanobridge brings two worlds together⏎(Nanowerk News) A gadolinium layer of no more than one nanometer in thickness is capable of combining the magnetic world with electronics. In this way, it will be possible to put a

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   adult, and is located in the right upper quadrant of the abdominal cavity, just below the diaphragm. It’s functions include:⏎Manufactures half of the body’s cholesterol⏎Production of bile⏎Manufactures other substances including proteins vital to our

2. #2 peak

   triangle is equal to the sum of the squares of the sides containing the right angle." But Pythagoras had an all-inclusive vision,

3. #3 peak

   is essential to understand the performance of microorganisms because they play an important role in the day to day lives on earth.⏎Microbiology is the study of the living organisms which are small and cannot be seen with the naked eye. Some of the micro

4. #4 peak

   a low-lying seamount. Researchers writing in the upcoming Feb. 15 issue of the journal Geochimica et Cosmochimica Acta estimate that the volcanic island will continue to grow, thanks to plate tecton

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.