middle of technical terms in science text

What this neuron does

This neuron fires on the piece of a scientific or technical name that comes after the start, such as 'one' in 'pheromone', 'ome' in 'proteasome', or 'Survey' in 'Geological Survey'. It is mostly about word completion in science writing. Turning it up made the model repeat simple sentences, and turning it down gave unrelated story text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   only the males of the species got attracted towards the light source, mistaking it for female moths. Female moths secrete a chemical called pheromone, which has a scent and acts as sex appeal for moths. The infra

2. #2 peak

   either can’t make enough insulin to keep blood sugar levels down (type 1), or can’t effectively use the little insulin that it does produce (type 2).⏎First, to understand what happens in the bodies of people who have diabetes,

3. #3 peak

   of the gardenia’s foliage. They thrive when the weather is warm and dry. Whiteflies feed on the gardenia’s sap and secrete a sticky substance known as honeydew. This, in turn, attracts sooty mold,

4. #4 peak

   products, have been detected in about one-third of the wells sampled by the National Water-Quality Assessment (NAWQA) Program of the U.S. Geological Survey (USGS).1 Chloroform and other trihalomethanes,

5. #5 peak

   endonuclease from the 2009 pandemic influenza strain using the high intensity X-ray beams at the European Synchrotron Radiation Facility (ESRF).⏎The researchers were able to determine the 3D atomic structure of the enzyme

6. #6 peak

   itin side chains onto whatever protein is in close proximity, and when a protein is thus ubiquitinated, it is marked for destruction by the cell’s proteasome.⏎This means that you can,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   &D and Opus 12 Present: “Utilization of CO2 Emissions to Make Renewable Fuels and Chemicals"⏎Wednesday, July 29, 2020⏎10:00 AM PDT.⏎Opus

2. #2 peak

   ; hence, the popular phrase "Proverbs 31 Woman," while ignoring the advice for men. However

3. #3 peak

   SS⏎Using an SPSS data file, you'll test hypotheses with t-tests and regression analysis to predict risks and trends.⏎Tuesday, Oct. 14, 6-8 p.m.⏎If you are registered for a quantitative course at

4. #4 peak

   the Abnormal Silverline (Cigaritis abnormis), the Giant Red Eye (Gangara thyrsis) and the Large

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.