"D" in vitamin D, and "upstate"

What this neuron does

This neuron mostly responds to the letter D when it follows "vitamin", as in "vitamin D supplementation". It is strongly negative on the "state" in "upstate New York". Turning it up made the model repeat phrases, but the repetition was not about vitamins.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   body, and getting enough is critical to health and well-being, offering the promise of protecting bones and preventing bone diseases such as osteoporosis. Supplemental vitamin D is popular because it is difficult (if not impossible) to get enough from food

2. #2 peak

   less sunny locations. A recent review reported that many studies found reduced number of dental cavities for those with vitamin D supplementation.⏎There is also good evidence that vitamin D reduces risk of sepsis (blood infection). This infection often sends people to

3. #3 peak

   the ever present bacteria to invade, and second, by helping the innate immune system to fight the bacteria that lead to pneumonia.⏎There is also good evidence that vitamin D reduces the risk of viral infections. Influenza is more common in winter

4. #4 peak

   UVA and 5% UVB.⏎Note that no supplementation should be substituted for proper medical treatment in case of depression. Consulting a doctor about how much vitamin D is right for you is the best course of action for regulating your intake and staying

5. #5 peak

   benefit was production of vitamin D from solar ultraviolet-B (UVB) exposure, followed by strengthening the innate immune system.⏎There is also good evidence that vitamin D protects against other bacteria. The earliest evidence for other bacteria was for bacteria associated with

6. #6 peak

   body as waste products. Monitor vitamin D intake to ensure that you’re getting enough but not too much. The recommended daily allowance, or RDA, for vitamin D is 600 international units

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   spectacular fall colors of New England and Upstate New York. I still can’t get used to seeing Christmas lights on palm trees

2. #2 peak

   Secretary of the Treasury. It, and West Point located in upstate New York, are the oldest continuously garrisoned forts in the United States.

3. #3 peak

   has a long and storied history. Organizations that strive for equality for all races, genders, and religions can trace their origins back to a small gathering in upstate New York.⏎In 1848, at The Seneca Falls Convention

4. #4 peak

   five bats, and one each of a cat, skunk and fox).⏎On June 11th, a 15-month old child in West Seneca was bitten on the face by a rabid bat in the child’s bedroom.

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.