comma before a new clause

What this neuron does

This neuron lights up on a comma that comes right after a complete statement, just before the writer starts a new clause such as 'and the second is...' or 'but it...'. When it was turned up, the model fell into long loops of 'and, and, and'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   advantages over using a single drive to save data - the first one is redundancy, so if one drive breaks down, the data will be accessible from the remaining ones, and the second is improved performance as the input/output, or reading/writing operations

2. #2 peak

   24 and eighth-graders scored 274. The national average for fourth- and eighth-graders was 217 and 263, respectively.⏎Only Connecticut, Massachusetts, Montana and North Dakota scored higher than Vermont’s

3. #3 peak

   between the two have been the source of conflict for thousands of years.⏎Both the Jewish and Muslim faith believe in one God. Being monotheistic means just that, the belief in one God. This is the most obvious similarity between the two religions

4. #4 peak

   , and Reinforcement Learning.⏎Start with the question, “Do you have a Target Variable?” If the answer is ‘Yes’, it is a supervised learning problem, and if the answer is ‘No’, it

5. #5 peak

   AC⏎An airport in Japan will start collecting snow in 2010 to keep the terminals cool during the hot summer months. It sounds a bit crazy, but the small agricultural community of Funagata has been using snow technology since

6. #6 peak

   two main blood groups, the ABO group and the Rh group. The ABO group is made up of A, B, AB, or O blood types, and the Rh group is either positive or negative. You blood groups help doctors know

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   a series of images of the same blurry face — with the hint that it was a non-American political leader — as it would appear from 200, 100 and 50 meters. At 50 meters,

2. #2 peak

   litres of water a day, the UN Food and Agriculture Organisation (FAO) calculates that the water needed to produce a day’s food can range between 2,000 and 5,000 litres.⏎It is hard to

3. #3 peak

   ⏎Here’s another great example video done by Nick in After Effects using precomps!⏎Check back next week to learn the difference between frame rate and shutter speed, or view more lessons at the Vimeo Video School .<|endoftext|>Some time back I presented

4. #4 peak

   00 DPI optical mice as well as 800 DPI laser mice are very popular, but some high-end models are capable of 1000, 1600 or even 2000 DPI tracking speeds.⏎

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.