blank spot where an age or number goes
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the spot just before a number, especially after words like "age", "between" or "older than", so the model is expecting a figure next. Turning it up made the model drift into talk about numbers and percentages, which fits this pattern loosely.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ethnic minority students. Samples: One hundred and five preservice teachers (90 female) with a mean age of 26.20 years (teaching experience: 57.5
-
In 2018, about 21.2 million people age 12 and older, or approximately 1 in 13 people in this
-
had almost 150 years to adapt to a change from 10% to 20% in the proportion of the population that was older than 60 years, places like Brazil, China and India will have slightly more than
-
children who didn’t have the disease. Each group shared the same gender, age, and combination of genetic risk factors for celiac disease. The children were between 15 months and 8 years old when they were diagnosed for celiac disease
-
The history of art can be traced back to cave paintings of about 15000 BC. Gotell, E., Brown, S.,
-
of health, how it manifests and the consequences for people and society.<|endoftext|>Fact 1: The world’s population is rapidly ageing⏎The number of people aged 60 years or older will rise from 900 million to 2
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The role of a teacher in the early years. The first thing is that they can't have any problem with this or anything else. The first thing is to get the students into the early years. The age of teaching. The age of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1619 and set an example for others to follow. As Virginians migrated in search of new opportunity, they took these lessons of self-rule they had learned and put them
-
College in Oakdale, NY, who also teaches elementary school special education classes. When reading to her students, Granieri thinks out loud — commenting on how the text may add to the child’s knowledge of the topic. For example
-
pursuits, whether you are an amateur or professional.⏎Perfectionism is unproductive, however, when it is linked to excessively high standards and is driven by a fear of failure.⏎Back to top⏎Types of Perfectionism⏎Perfectionism
-
lescent anorexia develops in boys too.”⏎Anorexia Nervosa Symptoms⏎A person with anorexia usually displays these:⏎- Intense fear of gaining weight or getting overweight even when they could be underweight.⏎- Would have
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:298 weakly excites
- L11:1284 weakly excites
- L8:756 weakly excites
- L6:1140 weakly excites
- L7:2395 weakly excites
- L10:1295 weakly suppresses
- L2:1906 weakly excites
- L11:44 weakly suppresses
- L8:2309 weakly excites
- L9:837 weakly suppresses
- L10:844 weakly excites
- L5:279 weakly suppresses
- L2:94 weakly excites
- L11:2035 weakly suppresses
- L7:1929 weakly excites
- L8:64 weakly excites
- L10:2768 weakly excites
- L7:2889 weakly excites
- L5:2065 weakly excites
- L7:469 weakly suppresses
- L2:1172 weakly suppresses
- L8:1062 weakly excites
- L6:1776 weakly suppresses street and urban place names
- L0:3050 weakly excites
Feeds later layers
- L19:2939 weakly suppresses
- L13:2527 weakly suppresses
- L15:1860 weakly excites
- L21:1231 weakly excites
- L14:2708 weakly excites
- L15:233 weakly suppresses
- L22:359 weakly excites
- L17:1967 weakly suppresses
- L18:523 weakly suppresses
- L13:1171 weakly excites
- L13:2466 weakly excites
- L22:1755 weakly excites
- L13:2414 weakly suppresses
- L13:2362 weakly excites
- L18:2180 weakly excites
- L14:1647 weakly suppresses
- L20:1283 weakly excites
- L13:3027 weakly excites
- L23:294 weakly suppresses
- L23:2299 weakly excites
- L13:314 weakly excites
- L18:991 weakly excites
- L21:852 weakly excites
- L15:1815 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- apest
- 就被
- abe
- setDefault
- 专项行动
- aspers
- >{@
- atti
- activity
- 地址
Suppresses
- urple
- ieve
- 匦
- ерь
- ющую
- unya
- ikk
- 明日
- �
- ivel