web citations, urls and dateline dashes
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires inside web addresses, reference lists and article credits, such as the dash in a link or the start of a citation. It is strongly pushed negative by the dash after a city name at the start of a news story. Turning it up gave loose, rambling text that did not clearly follow this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Goods and Deforestation. voluntary private sector purchasing policies and investment standards. However, there has been limited analysis⏎Letter To Editor Regarding The Concern For Deforestation. Dear Editor, Monika’s Doggie Rescue covered a holistic statistics released by NSW government
-
scientists with a strong interest in teaching.⏎Folkert van Werven, and Alexi Goranov. 7.342 To Divide or Not To Divide: Control of Cell Cycle and Growth by Extracellular Cues, Fall
-
full article here: http://ourgame.mlblogs.com/2014/08/18/out-at-home/⏎- Related link: Click here to view photos from the 17
-
,” he said.⏎For the rest of this article, click here: http://www.abc.net.au/news/rural/2017-05-23/the-future-of-automation-in-the-mining-industry/8
-
: Philosophy and the New Science in the University. The Hague,Nijhoff.⏎Gordon Fraser (ed.) (2009). The New Physics for the Twenty-First Century. Cambridge University Press.⏎C. W. Kilmister
-
to the full article PDF.⏎Price includes VAT (USA)⏎Tax calculation will be finalised during checkout.⏎Feng ZW, Cao HF, Zhou XP (1999) The effects of acid precipitation on the ecological environment and restoration
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the world's most powerful nation-state in the Earth's landlocked country, the foreign policy officials in the West have confirmed that the government's foreign policy team has been on the ground in the southern Africa region in the western Africa coast south of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
à jour : 05/07/2021⏎Ajouter un commentaire<|endoftext|>By DANIEL SUDDEATH⏎NEW ALBANY —⏎Judging by the pleasure clearly shown by the children as they wheeled their
-
the body, and consequently a bend is formed at the<|endoftext|>DENVER – Put on your poodle skirts and tune in Elvis on the transistor radio, because
-
aP2 acts as a signal in cells, setting off a chain of inflammatory and<|endoftext|>, January 13, 2010 (ENS) - Eight landfill methane capture projects were recognized by the U.S. EPA Tuesday for innovation
-
. Your student might just be flattered (if not shocked) that you'd be insightful enough to ask.⏎By Rod Machado<|endoftext|>PARIS — Should Palmyra be rebuilt? And under what conditions? No sooner had Syrian
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:1221 strongly suppresses comma or verb after a researcher or study subject
- L11:1391 strongly excites
- L12:978 strongly suppresses
- L13:1869 excites
- L13:1115 excites
- L13:1152 suppresses
- L13:257 excites
- L10:2212 suppresses
- L7:741 suppresses
- L13:52 excites
- L12:1316 excites
- L12:1176 suppresses
- L13:1501 suppresses
- L10:2988 suppresses
- L7:1766 suppresses
- L7:1454 excites
- L13:1414 excites
- L11:1974 suppresses
- L13:1558 suppresses
- L6:1449 excites
- L11:595 suppresses
- L8:1072 suppresses
- L7:3050 excites
- L12:2758 excites
Feeds later layers
- L15:1687 suppresses
- L18:796 suppresses
- L16:1903 suppresses
- L17:808 excites
- L15:2008 suppresses
- L18:2980 suppresses
- L15:2134 suppresses
- L16:2895 suppresses
- L19:768 suppresses
- L16:2772 suppresses
- L18:1031 suppresses
- L20:2429 excites
- L15:1046 weakly excites
- L16:1688 weakly excites
- L17:2281 weakly excites
- L16:2007 weakly suppresses
- L17:2032 weakly excites
- L15:332 weakly suppresses
- L17:2320 weakly excites
- L15:1504 weakly suppresses
- L20:2495 weakly suppresses
- L15:290 weakly suppresses
- L16:1887 weakly excites
- L17:2329 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- afterward
- /logout
- :</
- 班车
- UnderTest
- iqué
- @endif
- →then
- then
- *)&
Suppresses
- 的一项
- 有一种
- 悄然
- 近日
- สำรวจ
- 的世界
- OURNAL
- vue
- unthinkable
- vis