'had' or 'has' after a subject (perfect tense)

What this neuron does

This neuron fires on the word 'had' in phrases like 'I've had' or 'Teachers have had to', which is the past participle used in perfect tenses. It seems to switch off on 'has' in some sentences, but the pattern is only moderately clear. Turning it up made the model's text drift toward unrelated topics.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   can be utilized, with rye and millet being probably the most well-known. Different decisions are corn, wheat, and various cereal grains. I’ve even had the best of luck with popcorn!⏎Grain can make sawdust generate more

2. #2 peak

   of empowering individuals in these everyday domains are much more likely to maintain a vibrant democracy in traditional political settings.⏎I might blog about it next week, after I’ve had a chance to read it, but one finding caught my eye.⏎People across the

3. #3 peak

   respond to them very well. With their education in mind, schools and nurseries all over the world have resorted to online learning. Teachers have had to rework their teaching methods and try to engage children through the screens. They

4. #4 peak

   investigate the CIA and to make sure that they are not engaging in activities that are not authorized by law.⏎Who has oversight over the CIA⏎The US Congress has had oversight responsibilities over the CIA since the Agency was established in 1947

5. #5 peak

   . She struggles with some behavioral problems at the home and has difficulty communicating her needs to the staff.⏎Dr. Smith remarks, “I notice that Stephanie has never had a pap smear before, at least according to our records. I wanted to check

6. #6 peak

   have found disturbing concentrations of pesticides in some baby foods. And the U.S. Department of Agriculture has found weed killers widespread in finished tap water. Environmentalists have had important successes in forcing pesticides that presented unacceptably high dietary risks off the market

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   Published: 23rd Dec 2011 08:41:37⏎The prospect of untreatable gonorrhoea has provoked alarm around the world, and there are no new classes of antibiotics in development

2. #2 peak

   , an entomologist at the Smithsonian Tropical Research Institute and father of two of the kids, had been tending to this tree, and was worried that it had suffered irreparable damage. But when he returned later, he was in for a

3. #3 peak

   subspecies (type) of milk snake is a method of helping control body temperature.<|endoftext|>ABC News reports:⏎Public health officials have announced that a squirrel in Colorado has tested positive for the bubonic plague. The town of Morrison, Colorado, in

4. #4 peak

   5 inches. Slopes range from 4 to 60 percent.<|endoftext|>RIVERSIDE, Calif. – Biologists at the University of California, Riverside have found that voluntary activity, such as daily exercise, is a highly heritable trait

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.