'of' after a noun phrase head

What this neuron does

This neuron reacts to the word 'of' that follows a noun in phrases like 'the factory of the future', 'technology of the time' or 'Rookie of the Year'. When turned up, the model's output became a long string of the word 'of', which fits what it pushes toward.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   and explore their potential impact on our lives.⏎Artificial Intelligence and Machine Learning⏎Artificial intelligence, or AI, has emerged as one of the most transformative technologies of our time. It encompasses machine learning, natural language processing, and computer vision,

2. #2 peak

   was black. But the cost of producing much smaller batches of a wider variety, with each product tailored precisely to each customer’s whims, is falling. The factory of the future will focus on mass customisation—and may look more like those weavers

3. #3 peak

   do to get past it.⏎The Pressure to Perform⏎Chuck Knoblauch was an outstanding baseball player in the 1990s. He won Rookie of the Year” and multiple Gold Gloves (outstanding defense). Because of his

4. #4 peak

   December 21,1940) was an Irish American Jazz Age novelist and short story writer, who is generally regarded as one of the greatest American writers of the Twentieth Century. Fitzgerald's The Great Gatsby was perhaps the great

5. #5 peak

   ⏎Front cover (photo)⏎Back cover (photo)⏎The Hughes Steamer⏎Like most young men, Howard Hughes was fascinated with automobiles. Unlike most other young men

6. #6 peak

   New technologies often adopt the terms and design characteristics of the tech that came before them. So this wasn’t simply the television set of tomorrow, it was the radio set of tomorrow — now with TV!⏎This amazing bit of Depression-era futurism

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   OF CARBOHYDRATE METABOLISM⏎due to an inborn error in the metabolism of carbohydrates occurs in fructose-1-6⏎diphosphate deficiency and in fructose-1-phosphate aldolase deficiency⏎(

2. #2 peak

   After putting the drops in, keep the head tilted for several minutes to evenly distribute the medication within the ear canal.⏎Side Effects: Like all medications, Ciprofloxacin/Dexamethasone Ear Drops may cause side effects, although not

3. #3 peak

   brew more sustainable beer. The company’s origins stem from the University of New South Wales where founders Constantine Tsounis, Khushal Polepalle and Bijil Subhash all met while studying.⏎“We’re chemical engineers but we’re also

4. #4 peak

   bacteria, while dexamethasone is a steroid that helps reduce swelling and inflammation in the ear.⏎Dosage and Administration: The usual dosage of Ciprofloxacin/Dexamethasone Ear Drops is one or two drops into the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.