the word a before long

What this neuron does

This neuron fires on the word "a" when it is followed by "long" or "while", as in "for a long time". The logit lens points the same way, toward the word "long". Turning it up made the model repeat "long" over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   is easy to find, looks beautiful in astro landscapes, and it contains a fantastic assortment of objects to photograph.⏎If you’ve been reading MilkyWayPhotographers for a while, you might think that the previous paragraph sounds a little familiar – well,

2. #2 peak

   sharp drop in the number of Purple Martins in Ontario and the reason behind this is not clear. Figuring out where they go to escape our cold winters will go a long way in helping us understand why their numbers are dropping. To start answering

3. #3 peak

   Aluminium is more affordable regarding prize. The advantage of stainless blades is that they are more durable than aluminum therefore once you buy them they are likely to serve you for a very long duration.⏎Various things should be put into consideration before purchasing a propeller

4. #4 peak

   , but the animals are sometimes abused by careless owners or harsh conditions.⏎- While the use of animals in entertainment, largely against their will, has been around for a long time, there are more and more anti-cruelty laws protecting animals

5. #5 peak

   _of_algorithms)⏎> 1 get a positive integer from input⏎> 2 if n> 10⏎> 3 print "This might take a while..."⏎> 4 for i = 1 to n⏎> 5

6. #6 peak

   Gear, talks about sophisticated gear manufacturing methods and how they can help solve common gear-related problems.⏎Noisy gear trains have been a common problem for gear designers for a long time. With the demands for smaller gear boxes transmitting more power at higher rp

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   still in development, the technology has far-reaching implications in both aeronautics and robotics. Cory was also named Boeing Engineering Student of the Year yesterday at Hamphsire, England's Farnborough Airshow. Click here to read an

2. #2 peak

   . Children who have fibromyalgia may also have pain or cramping in the lower abdomen with constipation

3. #3 peak

   of antihistamines include drowsiness which is compounded in people with fibromyalgia. Decongestants are stimulants which the doctor says can

4. #4 peak

   children and adolescents. Estimates suggest that juvenile-onset fibromyalgia affects 2% to 6% of schoolchildren, mostly adolescent

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.