commas after a 'since' clause

What this neuron does

This neuron fires on the comma that ends a 'since...' or similar reason clause, where the main point is about to follow. Turning it up made the model drift toward talking about reasons and ideas, while turning it down gave less clear results.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   even at the expense of personal well-being. It can, however, be difficult to separate MIT’s culture from its people. Since the people help create the culture, one cannot ignore the fact that MIT’s students tend to be internally driven and place

2. #2 peak

   the Fed injects more dollars into the economy it will show up as increased final demand/consumption and boost GDP. Since printing more money doesn’t create wealth, that doesn’t tell us much about our economic health (e.g., spending bo

3. #3 peak

   what comprises their skeletons. Calcarea sponges have limestone skeletons. Hexactinellida have skeletons made of silica. (Since glass is made from silica, these sponges are nicknamed "glass sponges." ) Scleros

4. #4 peak

   ’s new queen likely settled on the jet’s nozzle to rest (hives often migrate to new locations with new queens) and since the hive never leaves its queen, everyone decided to have a kick-back right on the nose of the military’s sh

5. #5 peak

   automation, robotics and many more. You can simply browse in the menu and on the page or leave a comment. Since new Raspberry Pi instructions and tutorials appear regularly, it is definitely worth activating the newsletter.⏎WiringPi is a library that is

6. #6 peak

   you do buy some transplants, keep the pots they come in and reuse them⏎Yes, you can also buy containers. But with all these free versions above, there really is no need to unless you want everything to look consistent<|endoftext|>Whether it

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   to the crest of the ridge where the best huckleberries grew.⏎Some years we got lucky. Every bush would be loaded, and we could be choosy—sampling deep

2. #2 peak

   The studio probably had little choice but to create a form letter.⏎I don’t think the form letter nature of the rejection is necessarily impersonal. It sticks to objective criticisms. Probably you can’t pin a rejection on a

3. #3 peak

   overwintering, and diapause—an insect version of hibernation.”⏎For example, “Boll weevils were thought to feed on pollen only, but my work reveals otherwise,” he says.⏎Nectars Could Be Where It

4. #4 peak

   too dangerous to fly. Her flight home to Vancouver had been scratched because it connected through Frankfurt, an aviation super-hub shuttered because of the overhanging haze. Hickson, who works for a private geothermal energy company, acknowledged the

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.