'at' after a verb or adjective
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'at' in set phrases like 'keep germs at bay', 'adding a minute at a time' or 'keep others at a distance'. Turning it up made the model repeat itself and drift into odd text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
good rule of thumb is to make sure that half of your plate is filled with fruits and vegetables as these foods are bursting with nutrients that help keep infection and diseases at bay.⏎Fight the flu.⏎Get a flu shot to avoid being laid up this
-
to what is called "hands-on" science has been growing in recent years at all levels of education, since the 1983 report "A Nation at Risk" criticized public education, including science curriculums, in American public
-
challenge). Alternately, if you feel 15 minutes is too much, start with five or 10 minutes and gradually build up, adding a minute at a time.⏎Exercise can help keep you stay fit during pregnancy, which will be
-
by a series of impersonal adults, she assumes a tough exterior to protect herself against further emotional pain. Her abusive behavior and rejection of friendly overtures keep others at a distance; she avenges her own pain by
-
and green leafy trees interwoven with Indian laburnum flowers. Behind the ‘choir fence’ of flowering shrubs lay the central cross, surrounded at the back by burial grounds. On the outskirts of the ‘church’, cheerful flowering
-
to another, it changes speed and bends.⏎- Light traveling from air and going into water – half submerged straight stick or pencil into water. The stick appears bent at the point
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: for and for, for and for, for and for, for and for, for and for, for and for, for and for, for and for, for and for, for and for, for and for, for and for,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, the airway narrows and wheezing develops within minutes as the lungs swell and passageways narrow. The wheezing will start in about 10 minutes, peak in 30 minutes and resolve in one to three hours
-
.⏎• Count your pulse for 10 seconds and multiply by 6 to find your beats per minute. You want
-
later than once predicted largely thanks to China's family planning policy, according to the country's top population experts.⏎Population growth has rocketed. It took just 13 years for 1 billion more people to live on
-
and block the blood flow. This may lead to serious complications such as infections, stroke, and acute chest syndrome.⏎A typical blood cell can survive up to 120 days whereas the sickle blood cells live only for 10 to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:569 suppresses
- L20:64 excites
- L22:2738 excites
- L19:1980 suppresses
- L21:310 suppresses
- L20:593 suppresses
- L22:353 excites
- L20:362 weakly excites
- L22:2062 weakly suppresses
- L6:7 weakly excites
- L6:16 weakly suppresses
- L5:110 weakly excites
- L13:1206 weakly suppresses
- L2:126 weakly suppresses
- L22:938 weakly excites
- L19:886 weakly excites the space before a rounded number
- L9:1974 weakly excites
- L0:665 weakly excites 'of' after 'capable' or 'incapable'
- L12:997 weakly suppresses
- L2:275 weakly excites 'of' after effectiveness or instead
- L8:13 weakly excites
- L9:549 weakly suppresses
- L11:838 weakly suppresses
- L9:1181 weakly excites
Feeds later layers
- L27:425 excites
- L27:797 excites
- L26:507 excites
- L26:248 excites
- L25:1114 excites
- L24:78 excites
- L25:210 excites
- L27:127 suppresses
- L27:399 excites
- L25:1586 weakly excites
- L27:1698 weakly suppresses
- L25:120 weakly excites
- L26:511 weakly excites
- L24:2464 weakly excites
- L25:544 weakly excites
- L25:298 weakly excites
- L24:73 weakly excites
- L24:2538 weakly excites
- L27:702 weakly excites
- L24:48 weakly suppresses
- L25:1612 weakly excites
- L27:231 weakly suppresses
- L27:2084 weakly excites
- L27:663 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- the
- ethe
- a
- hra
- _the
- its
- →the
- eph
- #{@
- 该
Suppresses
- 三大阶段
- 注册资本
- thereof
- 在这方面
- 的地方
- cies
- деятельности
- 的热情
- 个人观点
- 赛区