unclear: word pieces around turbines and wind shear

What this neuron does

This neuron fires on a mix of unrelated word pieces, most often 'turbines' in talk about engines and 'shear' in weather reports. It also dips on 'was' or 'is' in 'where was' questions. Turning it up made the model's writing wander without a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   cables, as in vertical-lift drawbridges, power shovels, and cranes. Before the extensive use of electric motors, steam engines or water turbines often supplied the power for factory machinery. One engine or turbine might run a whole

2. #2 peak

   September 13 local wind shear was having its effect on the storm, and Hurricane Humberto’s winds had begun

3. #3 peak

   4 hours. They predicted that very strong wind shear, dry air and a track over marginally warm sea surface temperatures could result in

4. #4 peak

   One might even say that Americans are a hero-worshiping people.⏎How can the American people love both equality and inequality simultaneously? How

5. #5 peak

   mud wallows or taking a nap in a big, fluffy hay bed. No, those aren’t warthogs you are looking at—these are one of the most critically endangered pigs in

6. #6 peak

   a lot of clay. I always dug the hole at least 25 percent deeper than the root ball and refilled that portion with watered-down good soil before placing the tree in the hole. The rest of the hole would

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   was this wreck, where was it located, why was it important? When did it happen?⏎2. What

2. #2 peak

   expelled the only red state in the national organizaton" -- but<|endoftext|>Raising Our Children to Be Gatekeepers⏎And the LORD said unto Cain, Where is Abel thy brother? And he said, I know not: Am I my brother

3. #3 peak

   2. Every day the boss enters the office⏎at half past nine⏎3. My friend will ring me up at eight o’clock⏎4. Where was Kate going when you met her yesterday?⏎does your brother work?⏎6. What

4. #4 peak

   or deep? Explain the type of plate boundary it was near. Why are earthquakes common to this area?⏎Where was the deepest earthquake during the week? On what type of boundary was this?⏎Where

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.