comma after sentence-opening adverb

What this neuron does

This neuron fires on the comma that comes right after a linking word that starts a sentence, such as Consequently, Actually, Indeed or Later. When it was turned up, the model's text did not visibly change in a way that matches this pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   also just transition policies.⏎Consequently, in order for climate action to be successful, indigenous peoples must be seen as powerful

2. #2 peak

   a shield.⏎Due to the widespread use of shields by all Carolingian troops, it became the most vital defensive armour for Carolingian armies.⏎Consequently, Carolingian monarchs such as Charlemagne specifically ordered different monasteries

3. #3 peak

   differentials.⏎Actually, there has been no shortage of explanation. Going through some of the literatures,

4. #4 peak

   of “Seeds of Deception”, in one of the first studies in the early 1990’s, rats were fed GM tomatoes. Actually, they refused to eat them, so they had to be force fed. And,

5. #5 peak

   to industrial robots, they are programmed to operate at lower speeds and with less ”torque strength”, making them safer to use in parallel to human workers.⏎Indeed, industrial robots are often used for larger sized tasks that require bigger installations to fulfill the

6. #6 peak

   data the supervisor of the construction was Bela Colov.⏎Later, the tower had a defensive character as well, especially in the time of the attack

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   subsequently destroyed by Danish invaders in the 11th century.⏎The wave of religious

2. #2 peak

   Thus, a system may consist of neural networks named Alice and Bob, and we aim

3. #3 peak

   Thus, the increasing demand for energy and exponential surge in consumption stimulates problems such as an

4. #4 peak

   thereby triggering a T cell immune response locally that then attacks cancer throughout the body. We

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.