unclear: weak mixed activations

What this neuron does

This neuron fires only weakly and on a mixed bag of things, including grammar exercises, digits in lists and a few single words. Nothing clear ties these together. Turning it up produced repetitive or wandering text with no obvious theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   Sustainability 2013, 5(7), 3006-3008; doi:10.3390/su5073006⏎I am honored to introduce this

2. #2 peak

   day, all three dogs were very hungry.⏎They started searching for food, but they couldn’t find anything. At last, they found a bone lying in the water.⏎They tried hard to get it but failed.⏎One of them thought that if

3. #3 peak

   the house The house is cleaned by Helen Some people collect pictures Pictures are collected by some people The dog killed a ratA rat was killed by the dog The teacher will explain the story The story will be explained by the teacher⏎Examples Simple present:

4. #4 peak

   , snatched off the order of St. George which he bore on his neck, and the Admiral, to show himself as great an enemy in adversity as he had been thought

5. #5 peak

   Protecting Your Family and Loves Ones, No Matter What Happens⏎The program uses direct cash transfers for girls who remain unmarried and in school, but somehow the factories have had more of an impact.⏎How can this be?⏎“When

6. #6 peak

   of various survey questions. Here we will go over what cross tabs are used for, how to set them up, and what the output will look like.⏎As mentioned, cross tabs are used for showing a side-by-side comparison of two or more

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   , Sea Level, Renewable Energy, Natural Resources, Climate, Weather, Non-Renewable Energy, Land,

2. #2 peak

   The answer to soaring gas prices lies in renewable heating, a technology that is ready to replace gas

3. #3 peak

   00,000), with mortality rates twice as high for African Americans as Whites (4.4 versus 2.2 per 100,000).⏎These researchers

4. #4 peak

   suggest that the symptoms of anxiety could exacerbate slow processing speed. For example, children with Obsessive Compulsive Disorder might appear to complete work slowly because they have developed internal rules such as needing to re-read an entire passage if they make a

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.