unclear: 'high tech' and mid-word pieces

What this neuron does

The neuron fires on a few scattered word pieces, such as 'tech' in 'high tech' and parts of longer words, with no clear shared theme. It fires negative on the 'or' in words like 'in-orbit' and 'sub-orbital'. Turning it up or down made the model's continuations change topic, but not in any way that connects to these words.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   ecosystem, and its ecological processes like sediment transport.”⏎But eight sites are being sized up for dam development along the Vjosa by foreign companies. The new Albanian government is privately resisting their approaches.⏎Edi Rama, Albania’s prime minister

2. #2 peak

   ") is the use of tools and labor to make things for use or sale. The term may refer to a range of human activity, from handicraft to high tech, but is most commonly applied to industrial production, in which raw materials are transformed

3. #3 peak

   Tick Paralysis⏎|Spinose Ear Tick⏎|Peanut-shaped and covered with small spines⏎||Causes intense irritation, rubbing

4. #4 peak

   health professionals. Much of this information depicts good health in terms of vigilance against the failings of our own bodies. This serves to create dependency on a high tech, commodity health system.⏎The style of language and the content of information are very

5. #5 peak

   dramatic and richly meaningful story of the Golden Calf and the Divine anger, of Moses’ pleading on behalf of Israel, and the

6. #6 peak

   ilage?⏎Cartilage plays a major role in many areas of your body. When looking specifically at your joints and surrounding structures, cartilage works to:⏎- Cushion your joints and decrease friction⏎- Hold your bones together⏎Exploring the Different

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   to three astronauts to low-Earth orbit. It encompasses a life-support and propulsion module, a re-entry capsule for their safe return to Earth, and an in-orbit module for temporary human habitation.⏎The forthcoming spacecraft will be designed with only

2. #2 peak

   24th October, 1946, when a V-2 rocket lifted the first ever space-bound camera above New Mexico on a short sub-orbital flight. From an altitude of 65 miles, a 3

3. #3 peak

   of particle acceleration could be happening throughout⏎the cosmos–from supernovas to solar storms–wherever a supersonic wind hits a⏎back home, Earth-orbiting satellites and departing astronauts have a new

4. #4 peak

   , of the neuropsychiatry and behavioral science departments on the College of South Carolina, Columbia. “The components of the mind liable for our flight-fight-or-freeze response would interpret each simulated and actual occasions identically and produce the identical

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.