'I' starting an acronym or word fragment

What this neuron does

This neuron fires on a capital letter 'I' that begins a short abbreviation or a piece of a longer word, such as the 'I' in 'IUCN', 'ILO' or 'IBS'. Its effect on the written output was hard to see, because the steered text was unrelated to this pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   edition of the International Basic Safety Standards. The edition is co-sponsored by seven other international organizations — European Commission (EC/Euratom), FAO, ILO, OECD/NEA, PAHO, UNEP and WHO.

2. #2 peak

   security, and many other scientific domains.⏎"NVIDIA and IIT Delhi share the common vision of developing technologies that boost computing performance to exas

3. #3 peak

   ), the Federal Institute for Drugs and Medical Devices (BfArM) and IFA. 03/31/2020.<|endoftext|>Def

4. #4 peak

   . The study, conducted on Drosophila melanogaster by scientists at the Institute for Research in Biomedicine (IRB Barcelona) and led by ICREA researcher Marco Milán, has reproduced each of the steps known

5. #5 peak

   the species.⏎The Great Slaty Woodpecker is a vulnerable species on the IUCN Red List, due to habitat loss. Without proper conservation measures, its

6. #6 peak

   In studies, up to 75% of IBS sufferers have been helped with a low FODMAP diet.⏎FODMAP

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   political contention until it was taken under the control of the autocratic Roman emperors.⏎- List of Latin phrases⏎- Roman circus⏎- Idiot/idiocy<|endoftext|>Four European capital cities lie on Danube, Vienna, Bratisl

2. #2 peak

   far stood outside the Standard Bank offices in Rosebank, Johannesburg, the Soweto Theatre in Soweto, the Iziko Museum in Cape Town, Maropeng in the Cradle of Humankind

3. #3 peak

   ) It is derived from the Hebrew Ebion, "poor," and was not given, as Origen supposes, for their low view of Christ. Id. at 6

4. #4 peak

   could be written on this subject. I'm guessing the "multi-million line production code base" in question is the Dropbox code base, and maybe Dropbox has an idiomatic way of writing Python with lots of "isinstance()"s.⏎> In

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.