'less' in 'colorless'

What this neuron does

This neuron mostly lights up on the ending 'less' in words like 'colorless', and on a few other word pieces. Turning it up made the model's writing drift toward unrelated topics, so the link is only loose.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   of incidence at large angles and a flatter response to different wavelenghts over the visible. Consequently, graded-index films are desirable in automotive applications where colorless coatings are required. A sol-gel process is presented for the formation of a

2. #2 peak

   can eventually lead to structural damage in your home if left untreated. A dehumidifier or air conditioner can help.⏎Answer: True. Radon—a colorless, tasteless and odorless gas—seeps into homes through cracks in walls

3. #3 peak

   often looks “cloudy”, tabular rectangle shape||Crystals are often half grey and half black.|⏎|Plagioclase feldspar||Colourless, sometimes looks cloudy, tabular rectangle shape||Stripy like a zebra

4. #4 peak

   ements are manufactured to meet the specifications of ASTM C150. ASTM C150 provides for ten types of portland cement: Type INormal Type IANormal, air-entraining Type IIModerate sulfate resistance Type II

5. #5 peak

   gases in the Periodic Table. It is the heaviest known gas, is radioactive, and is essentially inert. At ordinary temperatures, radon is a colorless gas, but when it is cooled below its freezing point it gains a stunning phosph

6. #6 peak

   eggs. They are colorless and about 0.1 mm in diameter. The eggs are negatively buoyant

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   hold their breath underwater for extended periods, making them excellent divers. The duration of a turtle’s breath-holding capabilities varies depending on several factors, including the species of turtle, water temperature, and activity level. While some species of turtles can hold

2. #2 peak

   Because of this, an arson investigator’s most important witnesses are the firefighters that first arrive on the scene. The investigator will ask firefighters for details such as the color of the smoke, damaged sprinkler systems, condition of doors and windows, and general

3. #3 peak

   is a class of diseases characterized by out-of-control cell growth. There are over 100 different types of cancer, and each is classified by the type of cell that is initially affected.⏎Cancer harms the body when damaged cells divide uncont

4. #4 peak

   under federal law.⏎Legal Liability for School-bus Accidents⏎Legal liability for injuries sustained by your child in a school-bus accident may depend on the type of parties involved.⏎

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.