'so' before much or many

What this neuron does

This neuron responds to the word 'so' when it means 'so much', 'so many' or 'so quickly', as in 'missed by so many news sources'. It is switched off, and even pushed the other way, when 'so' is followed by an adjective like 'so vast' or 'so covert'. Turning it up did not give a clear shared theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   several common cosmetic products, the harmful ingredient, the purpose for incorporating the chemical, and the adverse effect. So why is this still going on today when we know so much more about the effects? Unfortunately cosmetics are a low priority because of they are

2. #2 peak

   a tautology: US policy is democratic because America is free. One suspects that if there was more truth to the assertion it would not have to be repeated so frequently, but merely be understood.⏎But, let

3. #3 peak

   CPU hours and producing a hundred terabytes of data. And yet, when you ponder the vast sweep of space and time being modeled, it seems a marvel that so much universe can be squeezed into such a small box<|endoftext|>Tupac Shakur

4. #4 peak

   with more alert minds they should be more receptive to instruction.⏎The benefits are so obvious, in fact, it’s hard to understand how so many school officials were so easily motivated to do away with physical education classes in the first place.⏎After seeing

5. #5 peak

   contrast, an `io soaring over the Panaewa farm lots bears no resemblance to another hawk. It must have arrived a long time ago to have changed so much. But how long ago was that?⏎The answers have come recently by a

6. #6 peak

   . An expert at the Coastal Bend Bays and Estuaries Program (CBBEP) said things could have been much worse had the state agencies not responded so quickly.⏎Just north of North Beach, along Highway 181, is

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   it sank with its vast cargo of precious stones, jewellery, gold, silver and tobacco still on board. In fact, the value of this ravaged fleet was so vast that the Spaniards spent a decade attempting to salvage the remains. They brought

2. #2 peak

   - The Something is very different from the hunters and their dogs (the speaker knows all about them). The Something is far more covert. In fact, it’s so covert that no one sees or hears it make gaps in the wall.⏎- The

3. #3 peak

   he leads his black soldiers to death,⏎he cannot bend his back.⏎- By the time the 54th infantry fights its last battle, the Colonel is so exhausted from fighting that he

4. #4 peak

   one-quarter of the global average, and nearly 700 million of its citizens live in regions considered highly water-stressed. Meanwhile, groundwater depletion has been so significant in the areas around Beijing that parts of the city are falling into the earth

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.