commas inside numbers and lists

What this neuron does

This neuron reacts to commas that split up big numbers like 65,000 or place names like Newark, DE. When it is turned down, it is most active on commas that separate items in a list of actions. Turning it up did not produce a clear change in topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   . This one, called iBART, was a thing of beauty. Free, too. It was written by two former high-school buddies—Ian Leighton, a sophomore at UC Berkeley, and David Hodge, a sophomore at the University

2. #2 peak

   pelier, Vermont, on December 26, 1837. A hero of the Civil War and Spanish-American War, he was the first, and to date only, person promoted to Admiral of the Navy.⏎Marihuana

3. #3 peak

   five-a-day, it would now seem that even that is not enough.⏎Nutritional boffins at the University College London surveyed 65,000 people over 12 years and concluded that we should actually be

4. #4 peak

   nervous system, causing many of the disease’s symptoms.⏎How common is Citrullinemia Type 1?⏎Scientists estimate that 1 in 57,000 births are affected by Citrullinemia type I.⏎How

5. #5 peak

   really learn.⏎Beers, Kylene and Robert E. Probst. Notice & Note: Strategies for Close Reading. Portsmouth, NH: Henemann, 2013.⏎Using the work of Louise

6. #6 peak

   three Stanford researchers that delves into those pitfalls appears in Proceedings of the National Academy of Sciences. For their work, the team analyzed the results of 50,000 studies in 22 fields of science. “I think that

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   this product is for A SINGLE USER ONLY. That means that copying or sharing any part of this product with another teacher, grade level, school, department, district,

2. #2 peak

   , engines, or generators to control and adjust production of biofuels or biomass-fueled power.⏎- Operate equipment to start, stop, or regulate biomass-fueled generators, generator units, boilers, engines,

3. #3 peak

   ||fortran|⏎This entry (in part or in whole) was last reviewed on 4 February 2012.⏎Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version

4. #4 peak

   ctman & Horowitz, 2003). Studies find that people do not treat computers as people outside the mediation context (Goldstein, Alsio, & Werdenhoff, 2002) – just as people do

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.