empty slot before a number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the spot just before a number, such as in "at age" or "about" followed by a figure like 40 or 25. Turned down, it made the model repeat "has been" and "have", which is what it tends to push against.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
process that uses ionized air to increase the surface tension of non-porous substrates. Normally, corona-treating systems operate at an electrical voltage of approximately 10 kV.⏎Like corona, plasma is the electrical ionization of
-
a young age).⏎Guidelines differ for men at average risk. Some recommend an initial PSA (Prostate Specific Antigen) blood test and clinical examination at age 40, and others recommend starting at age 50. In general,
-
Figure 20-17 Intravitreal injection. The ocular surface was anesthetized with subconjunctival injection of lidocaine, 2%, in the inferotemporal quadrant. An eyelid speculum was
-
routine screening tests for people at average risk of cancer. People with higher risk may be screened more often.⏎- Breast cancer: Get yearly mammograms starting at age 40, in addition to regular self-exams and exams by your doctor or
-
more susceptible to heat stress – lower-producing cows and Jerseys may be comfortable until about 25°C. High air temperature, humidity, solar radiation, and low air
-
, sleep inducing, and muscle spasm relieving effects.⏎The following doses have been studied in scientific research:⏎- For generalized anxiety disorder (GAD):⏎- 45 drops<|endoftext|>BROOKLYN BRIDGE FOREST⏎Our Brooklyn
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
such as dandelions and beetle grubs. Scientific evidence shows that these chemicals also affect people, especially children, and pets. Exposure to certain lawn care pesticides has been associated with increased risks of a variety of serious health problems, including asthma,
-
Here are some of the key health benefits of broccoli:⏎- May help to reduce the risk of cancer: Broccoli contains sulforaphane, a compound that has been shown to have anti-cancer properties. Studies suggest that sulforaphane
-
in diabetes.⏎An apple is low in calories and contains high fiber and for this reason it fills the stomach without increasing blood sugar levels.⏎In some researches, it has been found that apples have anti-diabetic characteristics. People even identified as pre
-
college is a great time to form this habit as it will serve you well throughout your life.⏎For one, exercise increases one’s energy levels. It’s also been proven to replenish brain energy reserves, especially in areas of the brain responsible for
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:2009 excites
- L17:2758 suppresses
- L19:554 suppresses subjects of conditional or advice clauses
- L15:2370 excites
- L3:1498 weakly suppresses
- L12:2355 weakly suppresses
- L18:2656 weakly excites
- L5:1090 weakly suppresses
- L19:2180 weakly suppresses
- L0:1111 weakly suppresses
- L14:1287 weakly suppresses
- L20:2512 weakly suppresses
- L20:2256 weakly excites
- L20:223 weakly suppresses
- L11:509 weakly excites
- L18:730 weakly suppresses
- L11:3023 weakly suppresses gender and race in lists of identities
- L19:2857 weakly suppresses
- L9:2700 weakly suppresses
- L15:782 weakly suppresses
- L9:1329 weakly excites
- L20:2894 weakly excites
- L9:1010 weakly suppresses
- L16:837 weakly suppresses
Feeds later layers
- L24:243 strongly excites
- L23:1189 strongly suppresses
- L26:1914 suppresses
- L24:1770 suppresses
- L25:613 suppresses
- L27:756 suppresses
- L23:892 suppresses "the" in "over the past" time spans
- L24:60 excites
- L25:1726 weakly excites
- L23:1727 weakly suppresses
- L25:685 weakly excites
- L27:1387 weakly suppresses
- L24:2257 weakly excites
- L26:936 weakly suppresses
- L26:848 weakly excites
- L23:1164 weakly excites
- L23:1013 weakly suppresses
- L26:2133 weakly excites
- L23:747 weakly suppresses
- L25:1567 weakly excites
- L25:1995 weakly suppresses
- L24:2199 weakly excites
- L23:1173 weakly excites
- L27:1129 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- anced
- ериал
- 说不定
- ukes
- lime
- bons
- 览
- tutors
- еб
- -mort
Suppresses
- 've
- ’ve
- 已经被
- have
- 已被
- 已经
- has
- hasn
- 已
- haven