page-number hyphens in citations
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the dash between two page numbers in a reference list, such as 'pages 1619-1634'. It hardly fires on anything else that matters. Turning it up did not produce any clear citation-like writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Complications Not Increased with Fewer Antibiotics⏎Am Fam Physician. 2006 May 1;73(9):1619-1634.⏎Clinical Question: Does more cautious prescribing of antibiotics for sore
-
an-RM⏎Am Ind Hyg Assoc J 1980 Oct; 41(10):758-765⏎The effectiveness of open versus closed-face cassettes in aeros
-
, CT scan, rule, minor head injury⏎Ann Afr Surg. 2018;15(2):57-61 DOI:http://dx.doi.org/10.431
-
, and rheumatic fever in children: time trend analysis. BMJ. August 6, 2005;331:328–9.⏎Used with permission from
-
W.E. (1995). Using groundwater for hydro electric power generation. Journal of Hydrology (NZ), 34(1), 1-14.⏎Permanent Research Commons link: http://hdl.handle.net/10
-
posed to gestational diabetes mellitus in utero. Diabetes Metab Syndr. 2019;13(5):2947-2952.<|endoftext|>- Published on Tuesday, 18 September
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: that the in a market economy, the only thing that the business is the only thing that the business and the business is the only thing that the business is the only thing that the business is the only thing that the business is the only thing
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of the work bells and the noise was too much for some. One worker left the following anonymous note when she left:⏎“I am going home where I shall not be obliged to rise so early
-
“proven safe”. They did the same with genetic engineering.⏎I’m pleased to see the Commissioner (who has not been shy to seriously attack the Government when she thinks they have it wrong), come up with sensible conclusions, and her further work
-
New York Times, Bureau of Labor Statistics⏎For Rampell, the figure makes a slam-dunk case for the financial benefits of graduating from college. Here is her take on what the graph shows:⏎The median weekly earnings for college graduates are $
-
Population Decline<|endoftext|>First posted on Myth & Moor in 2015.⏎"In Britain there were once hundreds of carnivals," writes Jay Griffiths in her excellent book Pip, Pip, a cultural
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:587 strongly suppresses
- L6:1156 strongly suppresses
- L7:487 strongly suppresses
- L4:2396 suppresses
- L10:489 suppresses
- L7:477 suppresses
- L7:2804 excites
- L4:2471 excites
- L9:521 suppresses
- L2:2339 suppresses
- L4:1314 excites
- L8:1239 suppresses
- L9:472 excites
- L2:1754 excites
- L4:911 excites
- L8:759 excites
- L2:1644 suppresses
- L1:2869 suppresses
- L0:1296 suppresses
- L9:2071 excites
- L10:898 excites
- L3:2226 weakly excites
- L1:2878 weakly suppresses
- L10:2116 weakly excites
Feeds later layers
- L21:1614 strongly suppresses
- L17:648 strongly suppresses
- L22:520 strongly suppresses
- L18:838 strongly suppresses
- L21:1021 excites
- L20:2754 suppresses
- L18:1594 excites
- L18:2226 suppresses
- L25:2038 suppresses
- L17:287 excites
- L24:1888 suppresses
- L27:737 suppresses
- L24:614 suppresses
- L16:1347 suppresses
- L22:687 suppresses
- L15:2172 excites
- L21:2081 excites
- L26:2449 suppresses
- L21:2560 excites
- L25:1075 weakly suppresses
- L23:421 weakly suppresses
- L23:2856 weakly suppresses
- L19:1375 weakly excites
- L23:1052 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- itus
- icho
- ATO
- Ạ
- \Builder
- medios
- bable
- TODO
- ->{$
- incurred
Suppresses
- maids
- 她们
- 嫁给
- adora
- arians
- jection
- jections
- herself
- 妮
- ари