numbers inside citation references
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the volume or issue number in a reference, like the 3 in a journal entry such as 2008;309. It stays quiet on most other numbers, and when it is turned up the writing drifts into unrelated topics without any clear link to citations.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. 2008. Do crocodilians get the flu? Looking for influenza A in captive crocodilians. Journal of Experimental Zoology. 309A:1-10. Interpretive Summary: Since crocod
-
be well represented in the efforts currently under way to elucidate the molecular basis of the genetic susceptibility to alcoholism.(JAMA. 1992;268:1877-1882)<|endoftext|>The Imag
-
ar abscess, mastoiditis, and rheumatic fever in children: time trend analysis. BMJ. August 6, 2005;331:328–9.⏎Used with permission from
-
was in the midst of the ‘War<|endoftext|>According to a recent study from the Journal of the American Medical Association (JAMA. 2010;303(18):1848-1
-
Am J Roentgenol 2008;190:273.) This traditionally is focused on reducing unnecessary CT scans
-
role in setting up or maintaining the 180 degrees rotational symmetry of the two flagella.⏎Rights and Permissions⏎Citation: J Cell Biol. 1983 Sep;97(3):9
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I can't be remembered. I can be remembered. I can be heard. I can be seen. I can be seen. I can be seen. I can be heard. I can be remembered. I can be seen. I can
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
weeks old. Then, check the back teeth; if it has yellowish stains/tartar buildup, your cat is likely around 1 to 2 years old.⏎It doesn’t end there; now, check for tartar buildup
-
⏎7 letter words⏎6 letter words⏎5 letter words⏎4 letter words⏎3 letter words⏎2 letter words⏎Images for ZEATINSLoading...⏎SCRAB
-
ask you to walk on our treadmill for up to 15 minutes. You are free to rest at any time. The whole process may take between one and two hours.⏎What is the most important piece of technology used in the
-
Wang Bei (2008). New Insight Into Mencius' Theory of the Original Goodness in Human Nature. Frontiers of Philosophy in China 3 (1):27 - 38.⏎Katrin Froese (2
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:2354 suppresses
- L10:1602 excites the number 1 as a unit value
- L4:205 weakly excites the digit 2 inside citations
- L4:2474 weakly excites the word 'constant' in science and maths
- L5:746 weakly excites
- L9:1348 weakly suppresses
- L10:726 weakly excites
- L9:2840 weakly suppresses
- L9:977 weakly excites the last digit of a decade year
- L6:227 weakly suppresses
- L6:1286 weakly suppresses
- L0:646 weakly excites
- L5:166 weakly excites
- L3:119 weakly suppresses
- L8:2269 weakly suppresses
- L1:2220 weakly excites
- L6:980 weakly suppresses
- L7:683 weakly suppresses
- L8:184 weakly suppresses
- L5:1878 weakly suppresses
- L4:1886 weakly excites
- L9:1032 weakly suppresses
- L4:1470 weakly excites
- L7:844 weakly suppresses
Feeds later layers
- L12:1272 suppresses
- L13:1397 suppresses
- L18:1622 weakly suppresses
- L16:1120 weakly excites
- L12:947 weakly excites
- L15:1758 weakly suppresses
- L12:455 weakly excites
- L18:2895 weakly suppresses
- L25:694 weakly excites
- L19:2546 weakly excites
- L20:2979 weakly excites
- L18:1264 weakly excites
- L16:1060 weakly suppresses
- L20:2234 weakly excites
- L27:2027 weakly excites
- L13:2276 weakly suppresses
- L24:1852 weakly excites
- L17:454 weakly excites
- L13:2098 weakly suppresses
- L20:2667 weakly excites
- L18:2221 weakly excites
- L19:1487 weakly suppresses
- L17:2189 weakly suppresses
- L19:1312 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- isans
- ilia
- ISION
- цов
- ок
- _mp
- urpose
- inity
- สา
- isas
Suppresses
- exter
- 回来了
- cci
- ster
- decor
- letter
- GetX
- ativo
- 图书
- 回来