comma after a full date

What this neuron does

This neuron lights up on the comma in dates like 'Jan 09, 2017' or 'July 12, 2017', the spot right before the year. It goes quiet, or flips negative, on the middle digits of years written inside text, such as the '3' in 1380. Turning it up mostly made the model fall into loops of blank lines, so the steering results do not tell us much more.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Jan 09, 2017 08:57 AM EST⏎MIT Professor

2. #2 peak

   direction you would get more water pressure (voltage) because the pumps are helping each other<|endoftext|>Canine fear-related aggression (Proceedings)⏎Nov 01, 2009⏎CVC IN SAN DIEGO PROCEEDINGS⏎

3. #3 peak

   pale little girl with a thin neck, and spindling legs half-hidden in the folds of Aunt Frances’s skirts. But she didn’t<|endoftext|>Dec 6, 2023⏎Airbus has successfully passed the Preliminary Design Review

4. #4 peak

   York Times, Project Glass, technology, turn by turn directions, UI, User interface, video chat, Virtual reality, Virtual reality glasses⏎January 18, 2012 • 11:07 am

5. #5 peak

   with something familiar for scale pic.twitter.com/OdQA07qhBb⏎— Adrian Luckman (@adrian_luckman) July 12, 2017⏎You may imagine that the breaking off of the iceberg

6. #6 peak

   every bit of opinion you might start writing, think of including an “and…” statement.⏎— Danielle Degelman (@deedegs) November 26, 2014⏎One approach if giving criticism is to put it inside

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , is thought to be the name or epithet of a Kartid amir or military commander. Destroyed a second time by Timur’s army (1380), Qal’a-ye Ikhtiyar al-Din was

2. #2 peak

   the pope's favor forced him to leave Rome and work for King Alfonso of Naples (1452-1455), but he resumed his position as papal

3. #3 peak

   emerged as the leader of local Turks in the fight against the tottering Byzantine Empire. The final conquest of the Byzantines was not achieved until 1453 with the fall of Constantinople (now Istanbul), but by that date

4. #4 peak

   Colov.⏎Later, the tower had a defensive character as well, especially in the time of the attack of Omer Pasha on Montenegro in 1862. At the end of the 19th century this building was

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.