"of" after quantity nouns (millions of, amount of)

What this neuron does

This neuron fires on "of" right after amount words such as "millions of", "amount of" or "heap of". Turned up, the model repeated "more" and "snow" rather than saying anything about amounts.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   , said Brian Jaskula, a lithium commodities specialist for the U.S. Geological Survey.⏎If successful, the operation could also generate millions of dollars to be used to combat the shrinking of the Salton Sea and the<|endoftext|>

2. #2 peak

   than or equal to 1 mile, in just 1 year. Simply cutting out these short journeys could save millions of square metres of ice caps. How many of these trips could actually be made on

3. #3 peak

   o file.o⏎Actually, the ``-o file.o'' is optional<|endoftext|>Photography is an approach of taking a photo with an electronic camera over an amount of time. An individual that produces pictures with a digital camera is called a digital photographer

4. #4 peak

   lands offer nesting sites. Collisions between birds and aircraft, a.k.a. bird strikes, are a possible hazard. Not only do bird strikes lead to billions of euros in damages to aircraft, they

5. #5 peak

   text. It is composed of a sequence of characters that define a search pattern. Regex can be used to find patterns in large amounts of text, validate user input, and manipulate strings. It is widely used in programming

6. #6 peak

   web-based systems.⏎So, despite spending millions of dollars on these ERP systems, organizations are still being relegated to the use of manual

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   diabetes and vascular disease placing prevention in the middle of the mental picture we would draw of a healthier world. Worldwide, the number of people with diabetes rose from 108 million in 1980 to 422 million in

2. #2 peak

   Supplement, close to 20% of students deal with bullying problems. Similarly, the 2017 Youth Risk […]⏎Nurturing children is one of the challenging and rewarding responsibilities on earth— and you have to be prepared and

3. #3 peak

   Lumbosacral Region of the SpineSkip to the navigation⏎The spine is composed of 33 interlocking bones called vertebrae. The lumbosacral region

4. #4 peak

   very little work. Pop a handful of them in your mouth and chew the health benefits of almonds with joy.⏎Getting healthier by understanding nutrition is one of my main goals. I love eating almonds, especially because of how good they

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.