'the' before study or journal names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'the' in news sentences about research, such as 'published in the journal' or 'a study by the'. It is weaker and less clear on the negative side, where 'the' comes after verbs like 'took' or 'do'. Turning it up made the model drift into loops about nations or a repeated phrase.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
chocolate may ease depressive symptoms and have a positive effect on mood, according to a new study led by University College London (UCL).⏎The study, published in the journal Depression and Anxiety, looked at whether different types of chocolate might be linked to
-
to lower risk of death⏎Diets high in protein, particularly plant protein, are associated with a lower risk of death from any cause, finds an analysis of the latest evidence published by The BMJ today. ...continue reading "Diets High
-
that there are also long term repercussions,” said Silje Steinsbekk, study author and associate professor and psychologist at NTNU.⏎This research is published in the Journal of Developmental & Behavioral Pediatrics.⏎Previous news in sleep:<|endoftext|>In the
-
and aids. The study, published in the May issue of the American Journal of Preventive Medicine, also finds men and those
-
nicotine than their labels show. Or much less.⏎That's the finding of a new study by the Salt Lake County Health Department and the Center for Human Toxicology at the University of
-
role of cosmic chemistry in the Universe.<|endoftext|>A recent study found that mice that ate more cinnamon got better and faster at learning. In the study, published in the Journal of Neuroimmune Pharmacology in 2016, separated mice into
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: For all $ a_n = a_{1}^{1 + \alpha_{1}^{1} + \alpha_{1}^{2} + \cdots +_{1}^{_{1} +_{1}^{1
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and it was still supposed to be a kind of “Fußball“. My guess is, though, that the limited mobility of the mannikins simply took the fun out of it for me.⏎My first encounter<|endoftext|>
-
35-6.) Back.<|endoftext|>I’m all for brain teasing toys but I never had a knack for them. I blame my parents. Don’t make the same mistake and get your kids an OBLO – a 3D didactic
-
's lithosphere," he said. "But when we calculate the forces available from plate tectonics, we find that they are not large enough to do the job. We know that continents break apart and have done so repeatedly in the geological
-
as a waste of time and energy.⏎So the strategy changes: evacuate the vulnerable, the impossible to defend. Defend that which can be defended, wait for the fire to burn itself out and pray for rain.⏎It seems to be the same
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:1168 excites
- L10:1377 suppresses
- L4:52 excites
- L9:24 excites "the" before a named organisation or title
- L9:662 suppresses
- L10:120 suppresses
- L10:1644 excites
- L3:344 excites
- L9:2198 excites
- L4:73 suppresses
- L2:205 excites
- L15:888 excites
- L6:61 suppresses
- L4:392 suppresses
- L2:1390 suppresses
- L2:1439 excites
- L12:435 suppresses
- L14:254 excites
- L1:59 excites 'the' after a verb or preposition
- L9:1811 excites
- L1:740 suppresses
- L5:493 excites
- L3:291 excites
- L9:227 excites
Feeds later layers
- L22:501 weakly suppresses
- L17:2222 weakly excites
- L20:514 weakly excites
- L24:166 weakly excites
- L27:854 weakly suppresses
- L19:162 weakly suppresses
- L17:2236 weakly excites
- L18:2520 weakly suppresses
- L17:1008 weakly excites
- L20:1246 weakly excites
- L19:866 weakly suppresses
- L27:2146 weakly suppresses
- L21:930 weakly excites
- L25:2438 weakly excites
- L18:1334 weakly excites
- L22:340 weakly suppresses
- L18:2569 weakly suppresses
- L17:1907 weakly excites
- L19:2109 weakly excites
- L19:1384 weakly suppresses
- L24:364 weakly suppresses 'at' in 'at least' and 'most' or 'least' qualifiers
- L21:229 weakly suppresses
- L24:839 weakly excites
- L24:327 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ickers
- eted
- mer
- атур
- lette
- 以致
- hung
- oured
- istung
- acher
Suppresses
- stroy
- 诃
- BIN
- sts
- 讪
- ãi
- AMA
- OI
- }}</
- defaultProps