'of' after type or class nouns

What this neuron does

This neuron fires on the word 'of' in phrases like 'a specific type of', 'one interesting class of' or 'a special class of', where a category is about to be named. It seems to go quiet or negative on 'of' or 'in' after a quantity or a day, such as 'the second Monday of'. Turning it up did not produce a clear theme in the model's output.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   one interesting class of question is aimed at finding out the variety of situations those laws allow. For example

2. #2 peak

   active periods of years separated by decades of quiescence, are called persistent SXTs. In 2000, a special rare type of X-ray superbursts was discovered. Superbursts last for a few to

3. #3 peak

   not only mathematicians - like to consider more specific questions in order to get some feeling for what is happening. In this article we will reflect about a special class of Lunda-designs.⏎On the day before my daughter Likilisa's fourth

4. #4 peak

   CeMM Forschungszentrum für Molekulare Medizin der Österreichischen Akademie der Wissenschaften⏎An important step towards a completely new experimental access to quantum physics has been made at University of Konstanz. The

5. #5 peak

   . Of this number, around 30% will develop ER-negative tumors, making a woman’s risk of developing this specific type of cancer at some point in their lives around 3.72%. If it

6. #6 peak

   , strep throat can cause complications, such as kidney inflammation or rheumatic fever. Rheumatic fever can lead to painful and inflamed joints, a specific type of rash, or heart valve damage.⏎Strep throat is most common in children,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   residues after fossil fuels are burned and cool power plants.⏎Coal uses up to 3.2 cubic metres of water per megawatt hour (MWh) of electricity produced, gas uses up to 1.7 m3 per MWh

2. #2 peak

   and Congress passed a bill to establish a federal holiday in 1894. President Grover Cleveland signed the bill soon afterward, designating the first Monday in September as Labor Day.⏎Learners are Leaders, Inc.’s mission includes

3. #3 peak

   the purpose of taking the vote of the electors of the State, for the acceptance or rejection of this Constitution, an election shall be held on the second Monday of November, in the year 1857, to be conducted according to

4. #4 peak

   The Cassini-Huygens mission is a cooperative project of NASA, the European Space Agency and the Italian Space Agency. The Jet Propulsion Laboratory, a division of the California Institute of Technology in Pasadena, manages

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.