word right before a number value
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word just before a number, especially ages, percentages, and measurements, such as "age" in "at age 67" or "between" in "between 30-45 percent". When it was turned up, the model's writing filled up with digits and numbers.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
organized the Wounded Knee uprising, a 71-day siege that included several gun battles with federal officers. Means died in 2012 at age 72.⏎“He was the only person in (a) leadership position in W
-
0, in addition to regular self-exams and exams by your doctor or other health care provider.⏎- Colon and rectal cancer: If you are over age 50, talk to your doctor about getting one or more of several screening tests
-
a young age).⏎Guidelines differ for men at average risk. Some recommend an initial PSA (Prostate Specific Antigen) blood test and clinical examination at age 40, and others recommend starting at age 50. In general,
-
have thought, “What is the ideal level for my house in the summer or winter months?”⏎During the summer months, the average humidity should weigh in between 30-45 percent (below the 50% mark). Winter
-
and the relative humidity need to be low.⏎Conventional air conditioning consists of setting the humidity at an acceptable level, while reducing the temperature. A humidity level of 50% is usually comfortable. The most common method of reducing humidity is to
-
Extremely diverse country (92 mother tongues) The majority of the population are Hindu Adult Literacy Rate (6 and over): 53% Life expectancy: 68 years Home of Mt. Everest and the highest altitude lake in the world
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I think it is good service from a service company who values good service under good service tenasi (a tenasi tenasi tenasi tenasi tenasi tenasi tenasi tenasi tenasi tenasi tenasi tenasi tenasi ten
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
is unsurprising that women may experience an unplanned pregnancy or a pregnancy they cannot carry to term on more than one occasion. No form of contraception is 100 per cent effective, and women will always need straightforward access to abortion services as
-
on the face covering or use hand sanitiser with a minimum of 60% alcohol base.⏎3. Be sure the front of the face covering is
-
! A candle made from soy wax burns cleaner, lasts longer and is less likely to trigger allergies! No pollutants, carcinogens or toxins! They are 100% biodegradable and on average burn longer than paraffin. (
-
free from the virus, especially during this COVID-19 outbreak.⏎- Regularly clean the device⏎- Use a disinfectant that contains at least 7
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:775 strongly excites
- L21:1866 excites
- L21:1732 excites
- L23:2592 excites
- L23:2230 excites
- L23:2093 suppresses
- L22:2783 suppresses
- L24:2097 suppresses
- L22:2902 excites
- L23:2835 suppresses
- L22:1368 suppresses
- L21:2695 excites
- L22:2703 suppresses
- L24:992 excites
- L19:1851 excites
- L24:1527 suppresses space before a number, often an age
- L23:2791 suppresses
- L22:2854 excites
- L23:1858 weakly excites
- L16:1206 weakly excites
- L24:2785 weakly excites
- L22:1931 weakly suppresses
- L22:1574 weakly suppresses
- L21:1659 weakly excites
Feeds later layers
- L26:580 excites
- L27:205 suppresses
- L27:1196 suppresses
- L26:905 excites
- L26:598 suppresses spot just before a year or century
- L27:328 suppresses
- L26:754 weakly suppresses
- L27:530 weakly excites
- L27:1100 weakly excites
- L27:678 weakly excites
- L27:902 weakly suppresses
- L26:898 weakly excites
- L26:413 weakly suppresses
- L26:737 weakly suppresses
- L26:868 weakly excites
- L27:494 weakly suppresses
- L27:1153 weakly suppresses
- L26:1591 weakly suppresses
- L27:1897 weakly suppresses
- L27:180 weakly excites
- L26:1110 weakly excites
- L27:1232 weakly excites
- L26:1418 weakly excites
- L27:496 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- fort
- peria
- icens
- 丝绸
- 侗
- uming
- שת
- Researchers
- cestor
- 绸
Suppresses
- 🔟
- gether
- ランス
- way
- lay
- _ten
- Montserrat
- jure
- tenth
- DISCLAIMS