'of' after 'learned' or 'because'

What this neuron does

This neuron fires on the word "of" right after verbs or links like "learned of" and "because of". Turning it up did not produce any clear theme in the model's writing, so the link to this word is only seen in the examples.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   helped, but I still felt weak, low in energy and mentally fuzzy.”⏎Then her husband, Richard Brown, a psychopharmacologist at Columbia University, learned of a Russian herb, Rhodiola rosea, which purportedly strengthened the whole

2. #2 peak

   Ocean Science (NCCOS) explain.⏎“We did this study because of concerns that putting marine finfish farms in the coastal ocean could have adverse effects on

3. #3 peak

   ative” (signed “story”) is sometimes preferred over “oral” because of an enduring history of “oral” education that has powerful, often painful, con

4. #4 peak

   It was early in the history of the Seneca when they first came across the spot where a black, sticky substance was rising from the water. They quickly learned of its potential as body paint, medicinal purposes, and as additive for making the flare

5. #5 peak

   Belgium⏎The rare disease affects the lungs, causing worries about the future for Fernanda.⏎Fernanda Aspilche can remember the exact day she learned of her diagnosis with Alpha 1 Antitrypsin Deficiency, a

6. #6 peak

   in your mouth and chew the health benefits of almonds with joy.⏎Getting healthier by understanding nutrition is one of my main goals. I love eating almonds, especially because of how good they are for you. Research more benefits of almonds to satisfy all of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , a task often complicated by poor-to-nonexistent Cold War recordkeeping;⏎- To prepare a waste management and cleanup plan that identifies

2. #2 peak

   shape of things to come for women will be shorter and plumper, and it's all thanks to natural selection

3. #3 peak

   northerners, but two of the invading peoples settled on the coast of Palestine, between Gaza and Mount Carmel. The attempted invasion ended Egyptian pretensions to a Syro-Palestinian hegemony.⏎Two more years of peace ensued, but

4. #4 peak

   so that she is certain not to go out of the lines while another little girl with the same princess coloring pages scribbles quickly in a hurry to get done first.⏎

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.