percentages and time spans in statistics
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up when a sentence is about to state a percentage or a length of time, like 'percent', 'years' or 'period' in statistics. It is most active on the spot right before the number or the unit. When turned up, the writing drifted toward numbers and percentages, though often in confused ways.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to finish secondary school than girls.⏎It’s also an issue that disproportionately affects the poor. The Africa Progress Panel reports that in Nigeria, for example, the richest 20 percent are in school for an average of 10 years, while
-
OSHA as an agency within the U.S. Department of Labor, workplace fatalities have been cut in half and occupational injury and illness rates have declined 40 percent. At the same time, U.S. employment has nearly doubled.⏎Under the
-
13.7% of adult blacks had completed high school. By 2014 this had jumped to 86.7%. Over the same period the percentage of black adults with a four year college degree jumped from 2.
-
male peers in math, technology, and engineering.⏎The number of MENA women employed or owning businesses has nevertheless only increased marginally in the past 30 years (although it should be noted that most global averages of female participation in
-
identity, and very importantly, increases their ability to stand up to peer pressure. According to his studies, those children and teenagers that can effectively argue with parents are 40% more likely to say “no” to negative peer pressure.⏎So
-
’s landscape. Of the 3,148 species assessed for population and distribution trends, 60 per cent have declined over the past 50 years; further research shows turtle dove numbers have plummeted by 80 per cent
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the fact that the real world is a place where people are. So, maybe I'm trying to be in a situation where they are. I think that. I can't understand. but I think that. I'm in a situation.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
exercise can help you stay healthy, independent and energetic as you get older. Exercise is anything that gets your body moving, and an average of 150 minutes a week is recommended
-
high sugar and fatty snacks.⏎People’s energy needs vary depending on age and activity levels but usually men require more energy than women. Men need about 2500 kcals and women about 2000 kcals per day.⏎
-
Texas schools are now required to evaluate students’ physical fitness, and eventually implement moderate to rigorous exercise programs of 30 minutes a day or 135 minutes a week.⏎The requirements were implemented for elementary and middle school students in 2
-
can inspire change in an industry. The Obama Administration’s Clean Power Plan goals for electric utility carbon dioxide—1,812-1,814 million
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:1742 suppresses
- L10:2772 suppresses
- L7:91 excites
- L7:1495 excites
- L11:917 excites
- L7:171 excites
- L10:1249 weakly suppresses
- L7:972 weakly excites
- L11:922 weakly excites
- L10:435 weakly suppresses
- L11:2712 weakly suppresses
- L10:468 weakly excites
- L9:333 weakly excites
- L9:285 weakly excites
- L10:2782 weakly excites
- L10:3056 weakly excites
- L1:1771 weakly excites
- L0:142 weakly excites
- L7:1562 weakly excites
- L6:974 weakly suppresses
- L8:400 weakly suppresses
- L11:2874 weakly excites
- L6:2840 weakly suppresses
- L11:95 weakly excites
Feeds later layers
- L15:1896 excites
- L18:1726 excites
- L15:2896 excites
- L14:258 suppresses
- L15:1926 excites
- L13:884 excites
- L17:1252 excites
- L14:840 excites
- L13:1705 excites
- L16:1154 excites
- L19:1233 excites
- L13:855 excites
- L15:2524 excites
- L15:1423 excites
- L15:2075 suppresses
- L19:1851 excites
- L16:2741 excites
- L18:3052 excites
- L14:1160 excites
- L20:425 excites
- L18:1739 excites
- L17:2076 excites
- L16:977 suppresses
- L17:2588 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 百分
- percentage
- 比例
- percent
- 个百分
- average
- 的比例
- 占比
- 环比
- 平均
Suppresses
- prowad
- iale
- 什么原因
- strument
- ustralian
- struments
- /orders
- rones
- __));⏎
- Melania