the letter r starting a word piece

What this neuron does

This neuron reacts to a single 'r' or 'A' that starts a fragment of a longer word, such as the 'r' in 'ratiocinate' or 'rancor'. When it was turned up, the model fell into repeating short phrases, with no clear topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   proportion.⏎5. (n.) To exercise the rational faculty; to deduce inferences from premises; to perform the process of deduction or of induction; to ratiocinate; to reach conclusions

2. #2 peak

   death, but he only thought that this relationship between Romeo and Juliet be the cure to their families grudge for each other.⏎Their love is forbidden because of a rancor between their families. As they arrange a marriage behind everyone’s back,

3. #3 peak

   by a group of nomads called the Aryans living in what is now Southern Russia. It is of course critical to mention the improper usage of the word "Aryan" in N

4. #4 peak

   the prey, my son, you have gone up. He stooped down; he crouched as a lion and as a lioness; who dares rouse him? The<|endoftext|>Juvenile striped bass spawned in the Chesapeake Bay were

5. #5 peak

   in the province of Taurida. He purchased sheep from the tsar's own flocks and also imported some rams from Saxony. At that time the average Mennonite farm had between

6. #6 peak

   prolific; they breed at about six months old, producing four or five litters, of from four to ten young ones in each, in the year. The raptorial birds keep down their numbers in

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   OR REARRANGEMENT REACTION. THIS EXPERIMENT WILL DETERMINE THE FACTORS OF ELECTROPHILIC SUBSTITUTION ON DIFFERENT AROMATIC RINGS TH

2. #2 peak

   ЛЬНАЯ РАБОТА ПО АНГЛИЙСКОМУ ЯЗЫКУ⏎КОН

3. #3 peak

   How Humidity Affects Flu Outbreaks⏎03-05-2009

4. #4 peak

   the most part, you will have positive outcomes. Though the process can be long, it is still worth the steps required to get greater hearing abilities.⏎Programming Hearing Aids

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.