unclear: word stems in technical text

What this neuron does

This neuron fires on the middle pieces of longer technical or specialist words, such as 'roasting', 'math', 'orthodontist' and 'writing', in informational articles. It goes negative on words like 'only' and 'this' after 'to do' or 'can'. Turning it up did not produce a recognisable theme in the model's replies.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   , with thousands of compounds being created and broken down. Green coffee is loaded into the heated roasting chamber and undergoes drying as the first stage of the roasting cycle. During the first few minutes, the beans desiccate most intensively

2. #2 peak

   crawl, stand and eventually walk.⏎Why is tummy time important?⏎Infants spend a lot of time lying on their back, especially a few weeks after being born. If they’re not lying on their backs, they are being carried or sw

3. #3 peak

   to Graphs⏎A formal introduction to graphs may be found in most discrete math textbooks. The purpose of this section is not to provide such an introduction. Rather

4. #4 peak

   /dev and /devices directories in response to dynamic reconfiguration events or file system accesses are handled by devfsadmd, the daemon version of the devfsadm command. This daemon is started by the service management facility when a system is bo

5. #5 peak

   on a TV monitor) to perform the surgical procedure. These laparoscopic procedures offer benefits to the conventional open surgery including:⏎- Reduced Risk of Infection⏎Single Incision laparoscopic surgery

6. #6 peak

   Care of Your Teeth with Braces⏎When you have braces, you'll have to be very good about following the brushing and flossing instructions your orthodontist gives you.⏎You can't eat hard, sticky or gooey foods such as

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   ism. We must remind them of what they knew as toddlers: mistakes are a valuable part of the learning process. Innovation and discovery can only be fostered if we give our children the freedom to fail. Schools can build

2. #2 peak

   in the right hands. It can determine the age, position and heart rate of the foetus, along with an indication of its overall health. But to do this consistently can take many years of practice.⏎Meanwhile, in developing countries, “a

3. #3 peak

   kinds of deception are supported by visual information?⏎These are the types of questions we are attempting to answer as we build our typology of visual misinformation. To do so, we are using the data from the CrossCheck French election project and First Draft

4. #4 peak

   <= R5+1; R6 <= R6-R3 would be held up in a non-scheduled pipeline, because the second operation based on R2 has to wait for the load from memory into R1, thus halting the CPU

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.