comma after an introductory phrase

What this neuron does

This neuron fires on a comma that comes after a short lead-in such as a year, a phrase like "as the name may suggest", or "As luck would have it". It seems to mark the point where a sentence is about to continue with its main statement. Steering did not give a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   2020, shows that even before the COVID-19 pandemic, majorities of citizens reported

2. #2 peak

   2021, Fox News report, Tucker Carlson asked the question no one is really allowed to ask

3. #3 peak

   2014, Whales as marine ecosystem engineers, Front Ecol Environ, http://www

4. #4 peak

   in operational or industrial processes), association mining (customer analytics), and latent variable models (factor analysis).⏎Semi-supervised machine learning⏎As the name may suggest, this model combines elements of supervised and unsupervised learning. It works by using

5. #5 peak

   on base called in a local beekeeper to clear the swarm, who also cleared up the air on how this happened in the first place. As luck would have it, this particular beekeeper also happens to be a veteran of the U.S.

6. #6 peak

   the CKSci Curriculum. Modern educational research has provided educators with new directions in communicating the facts and practices of science. Following the release of the Next Generation Science Standards, the Core Knowledge Foundation updated and enhanced the Grades 3–5 science portion of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   outcome of $400,000 compared to an average teacher.⏎Effect of Good Teachers on the Economy⏎What would happen, Hanushek wonders, to aggregate economic growth if poor teachers were replaced with good

2. #2 peak

   + d / . We might naturally conclude that the total luminosity, the sum of all the individual energies, would be reduced by the same factor. The conclusion, in fact, is valid in the particular

3. #3 peak

   a disposable one or do you get one that you can recharge? For that matter, why can’t you recharge all of them? What’s the difference? That, turns out, is a matter of science and cost.⏎How Batteries Work⏎

4. #4 peak

   0 more.⏎Finally, take two of those tiny fragments, each one thousandth of a paper clip or dollar bill, and hold them in your hand. That, according to the Drug Enforcement Administration, is

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.