"the" in size comparisons

What this neuron does

The neuron fires on the word "the" in phrases that compare something's size to a familiar object, like "about the size of a small dog." Turned up, the model started repeating "the temperature of the temperature", so the link to the trigger is loose.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   cken<|endoftext|>Ice shelf the size of Connecticut at risk of collapsing⏎- Grades: 3–5, 6–8⏎A hunk of ice about the size of the state of Connecticut has started to collapse in Antarctica. According to satellite

2. #2 peak

   is a changing mole.⏎What does Stage 1 melanoma look like?⏎Stage I melanoma is no more than 1.0 millimeter thick (about the size of a sharpened pencil point), with or

3. #3 peak

   What Are Bed Bugs?⏎Before we dive into the many different bed bug types, let’s talk some about what bed bugs are. Bed bugs are small insects about the size, shape, and color of an apple seed. These insects live in fabric

4. #4 peak

   of margarine is the size of one dice⏎- 3 ounces of meat is the size of a deck of cards⏎- 1 cup of pasta is the size of a baseball⏎- 1½ ounces of cheese is the size of

5. #5 peak

   for students without prior assembly-language background to master the many facets of pointer usage.<|endoftext|>International Day for the Remembrance of the Slave Trade and its Abolition⏎On the night of

6. #6 peak

   — the atomic jitters that pass through our world when two black holes bash together in a distant galaxy are on the order of a billionth of a billionth the diameter of an atom. LIGO detects them by proxy, using high powered lasers

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   .⏎The scientists wanted to examine if these observed effects were reversible. They returned mice to their normal diet after four weeks and were surprised to find that blood flow and blood

2. #2 peak

   been working on important experiments with metal alloys for aircraft. He had the results of seven years' labour in a portfolio with him and rather than let the research fall into German hands, (Poland having been invaded by Germany), he has hidden it

3. #3 peak

   how much further we need to go," said Dereth Glance, US Commissioner.⏎"This report is only the beginning as the Commission is defining important keystone indicators of ecological and human health that can be used over the long-term to assess

4. #4 peak

   teacher gets feedback about which questions were most attempted by students, which questions most students got wrong, etc. This helps teachers and school management to get an overall picture of what the real state of students is. Also, this provides critical feedback to teachers

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.