the zero in round numbers like 100

What this neuron does

This neuron fires on the zero inside numbers like 100, 1000 or 300, and on the word "seventy." It is about the size of a round number being written out. Turning it up made the model talk about numbers and counting, which is loosely related.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   74 Illingworth accompanied George Armstrong Custer’s expedition into the Black Hills, and he captured over seventy images. Illingworth was taken to court for embezzling government property

2. #2 peak

   Valley called TransitCamp. Inspired by a similar event in Toronto, the idea was to brainstorm what you might do with transit-agency data. Nearly 100 people came. One guy was looking to build a Web site that combined an online

3. #3 peak

   It's likely to get lost. Your character will appear wh<|endoftext|>The 45th annual PDK/Gallup Poll collected data from over 1000 Americans ages 18+ regarding the approach to improving the

4. #4 peak

   stability and serenity. Other significant plants on the property are especially notable for their maturity and precise placement. Some rhododendrons are over 100 years old, their gnarled trunks as attractive as their flowers. Tr

5. #5 peak

   -25 percent higher than houses with no trees.⏎Trees generate jobs and contribute raw materials for buildings, newspapers, books and more than 15,000 other forest products. Trees are renewable, biodegradable and recyclable.

6. #6 peak

   regulating your intake and staying healthy, both physically and mentally.<|endoftext|>Tech moves fast! Stay ahead of the curve with Techopedia!⏎Join nearly 200,000 subscribers who receive actionable tech insights from Techopedia.⏎A

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   reformer” led to his⏎appointment as head of Scots Church, Collins Street (1875-83) in Melbourne.⏎Yet, “almost from the hour of his arrival”, controversy was never far away⏎and his essays,

2. #2 peak

   , which heightens the intensity of this sound installation. The volume also oscillates—some parts are loud, others whir and buzz at levels that are almost inaudible, then it becomes tinkly and jolting before cycling back to

3. #3 peak

   and Ukraine, approximately in the 10th century. The Cossacks were known for their military

4. #4 peak

   excess weight, more than it is considered healthy for their height and age.⏎People with this disorder may go to great lengths to diet, almost to the point of starving or exercise even if they are underweight.⏎It’s all

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.