"the" after abstract topic nouns

What this neuron does

This neuron fires on the word "the" in lists or phrases about broad subjects, such as "the importance of the" or "Fans of science, mathematics, the". When turned up, the model repeated the word "concept" over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   philosophical figures: Archimedes, Sir Isaac Newton, Einstein, and more.⏎- Powers and principles in physics: Centrifugal and centripetal forces, the power of inertia, potential energy, kinetic energy, action and reaction law, buoy

2. #2 peak

   , environments, fossils, and dinosaurs, parts of the earth, natural resources, how the earth moves, light and shadows, how things move, heat, and the systems of the body. Science process skills are developed by participating in hands-on activities

3. #3 peak

   as such, the frequent references to it seem more like self-promotion than an attempt to contextualize and/or bolster his arguments. Fans of science, mathematics, the liberal arts, and the value of a well-rounded education may find themselves echoing Daniel

4. #4 peak

   Century. It will focus on a number of themes, including the impacts of war on the U.S., civil rights and expanding notions of citizenship, the expansion of the role of the federal government, and the rise of the U.S. as a

5. #5 peak

   this year’s edition of the UCD Connections magazine. In this article, Dr Tom Ryan writes that “87% of adults in Ireland recognise the importance of the environment

6. #6 peak

   critically.⏎- Through bookmaking, students learn to express and extend their knowledge of concepts-either abstract concepts, such as friendship, or concrete concepts, such as the food chain.⏎Common Core Standards⏎This resource has been aligned to the Common Core

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Water Buffalo (Bubalus bubalis),⏎- Guar (Bos gaurus), Rhino (Rhinoceros unicorns),⏎- Pigmy Hog (Sus salvanius).⏎Over 426 bird species are reported to be found in

2. #2 peak

   NSW government that a huge. Jan 06, 2014 · Case study on: Ganga water pollution 1. Submitted by: Shradddha Samant MMS

3. #3 peak

   of the land.⏎A quick search on the internet reveals that Lloyd George Street is in a popular part of the city with trendy shops, hotels, bars and The Lev Smadar, a highly regarded and comfortable arthouse cinema.⏎Unsurprisingly after

4. #4 peak

   etc. There is no confusion in the first name. The middle name can be seen from example – Ram Prasad Srivastava. Here First Name is Ram, Middle name is Prasad and Last

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.