unclear: mid-sentence tokens in web text

What this neuron does

This neuron fires on a grab bag of word pieces in the middle of ordinary web sentences, such as a date, a URL slash, or the word after 'In this paper'. There is no clear shared theme, and the strongest examples are hard to tell apart. Turning it up made the text wander without a clear change of topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   London: Volume 2. Originally published by Cassell, Petter & Galpin, London, 1878.⏎This free content was digitised by double rekeying. All rights reserved.⏎The Plague of 13

2. #2 peak

   radiation and chemotherapy to synergise the effectiveness of cancer treatment.⏎However, various problems in treating tumours with genetically engineered bacteria need to be addressed. In this review, we focus on the role of intratumoral bacteria

3. #3 peak

   fractals, dynamical systems, patterns of nature created through simple rules, and aesthetic graphics drawn from the universe of mathematics and art.⏎Chaos and Fractals is divided into six parts: Geometry and Nature; Attractors; Cellular Autom

4. #4 peak

   effect as lasting? Some believe not.⏎Taken from…. The Future of Education: Tablets vs. Textbooks http://mashable.com/2012/10/05/tablets-vs-textbooks/⏎They also say…. ‘

5. #5 peak

   portal/species/overview?p_p_spp=257336⏎This map is based on the maps available from

6. #6 peak

   meticulously documented. Known as "quantum tunneling," this strange phenomenon had previously been thought to occur only on very small scales.⏎In this paper I report instances of the spontaneous relocation of entire cats. Though cats are arguably quantal

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   table with a specific name or index exists.⏎The following example retrieves a single table by name from the DataTableCollection.⏎Private Sub GetTableByName() ' Presuming a DataGrid is displaying more than one table, ' get its DataSet

2. #2 peak

   information about survivors could not be confirmed<|endoftext|>A simple example of HTML is:⏎<HTML> <HEAD> <TITLE>This is the Title</TITLE> </HEAD> <BODY

3. #3 peak

   of fields.⏎The project is a continuation of Suhr’s previous work on nanotubes, which was published in Nature Nanotechnology. In this previous work, Suhr tested the strength and fatigue behavior of carbon nanotubes. He collaborated with

4. #4 peak

   >>> len(s) 13 >>> >>> len("") 0 >>>⏎>>> >>> s3 = '' # empty string using single quotes >>> s3 '' >>> >>> s4 = "" # empty string using double quotes >>> s4 '' >>> ```

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.