"in" or "real" after a verb

What this neuron does

This neuron fires on small connecting words like "in" right after an action word ("fly in tighter flocks", "operating in high temperatures") and on "real" in "real time". When it is turned up, the model's writing drifts in unrelated directions, so the effect is hard to see.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   and deeper wingbeats and proportionately narrower and less fingered wings. They also have a shorter, thicker neck, a much shorter bill and frequently fly in tighter flocks. The underwing is uniformly grey, unlike choughs.

2. #2 peak

   turbomachinery is limited when operating in high temperature environments, which restricts the efficiency of gas turbines and internal combustion engines

3. #3 peak

   line.)⏎- Sends alerts to drivers, staff and other stakeholders if someone is stuck in the gap.⏎- Uses existing camera infrastructure.⏎- Processes in real time, with low latency on a computer the size of a credit card (R

4. #4 peak

   cannot provide full torque continuously when the rotor is stopped. This aids in maintaining the current position.⏎- Precise open-loop positioning and repetition. Stepper motors move in discrete steps as long as the motor stays under the maximum torque and current limits.

5. #5 peak

   sense of responsibility towards them.⏎The companions<|endoftext|>The Internet of Things (IoT) is about connecting any device to the internet and enabling it to transmit data in real time without human intervention. This technology makes it possible for users to control their smart

6. #6 peak

   "tuneful, beatful, and artful." This is someone who: is able to sing in tune as well as catch tunes and is comfortable singing alone and with others; is

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   were real people" (11). He continues "it's plausible but unproven" and that is good enough for me.⏎Why do I love and admire Achilles so much? Let me count the ways. The "Greatest of the

2. #2 peak

   all great heroes of action was the Greek Hercules, who might almost be regarded as idolised toil. The adoration of this semi-god actually exceeded the reverence accorded to many of the twelve gods of the Greek and Roman Olympus. This

3. #3 peak

   acclaimed legend in her lifetime, a towering legacy left behind. Rest in peace, brave comrade,” she penned.⏎Former

4. #4 peak

   God is the only thing worthy of worship. Any other gods that others believe in, then we would regard them as false

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.