words that expect an of, to or for next

What this neuron does

This neuron fires on a word in an informative sentence that is usually followed by 'of', 'to' or 'for', like 'symbol' in 'a symbol of' or 'potential' in 'potential to'. Turning it up did not produce a clear visible theme in the model's continuations.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   it has spread to almost every state. With a widespread, shallow root system, it is ideal for thin soils where it will prevent soil erosion; it is often used for strip-mine reclamation projects barren due to mining debris and acid soils.⏎

2. #2 peak

   Kreimer et al., 2011). More information on HPV and cervical cancer.⏎In 2012 the U.S. Preventive Services Task Force and a coalition of health organizations published new guidelines for cervical cancer screening.

3. #3 peak

   Definition of endoplasm⏎n. - The protoplasm in the interior of a cell. 2⏎The

4. #4 peak

   what must happen in Advent, what Advent must be, if we want to live.”⏎The candle is an image of the Christian calling, and is also a symbol of the witness Father Delp gave in his suffering and death. In a sermon

5. #5 peak

   . "Fundamentally this question must be answered to advance the knowledge base and to know all the risks and benefits of cancer treatment. This research has the potential to reach across numerous scientific disciplines, and may one day improve the lives of patients worldwide

6. #6 peak

   EDX). This technique can provide not only information on the shape of aerosol particles, but also spatial relationships between the compounds that comprise those particles.⏎The power of optical microscopy is multiplied when coupled to techniques that can chemically speciate the object

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   baths. The antechamber leads to a courtyard with columns and walkways. The antechamber is not directly lined up with the axis of the courtyard – intentional? Diverts public traffic to the right side – which is a shorter pathway.

2. #2 peak

   classroom, when the class discusses and analyzes a work of fiction, poetry, or creative non-fiction, the main business of that discussion is to determine why the author made the

3. #3 peak

   to email@example.com.⏎Why are we doing this?⏎The purpose of making all information about children's rights available in one place is to build a clearer picture of some of the repeated violations of children's rights in

4. #4 peak

   Lutz: Tell me, why do you insist on referring to yourself in the third person? It's intensely irritating!⏎- Hercule Poirot: It helps Poirot to keep a distance from his genius.⏎

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.