citation punctuation inside references
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the commas, full stops and spaces that sit inside citations and bibliography entries, such as the spot right after an author's name in a reference. Turning it up did not produce a clear change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
used in electronics pollutes the air with oxides of nitrogen and sulfur, components of smog and acid rain.[i]⏎[i]Farrell, Leanne, Payal Samp
-
citation below to add this definition to your bibliography:⏎"acanthosis nigricans." Definitions.net. STANDS4 LLC, 2013. Web. 23 May 2013. <http://www
-
-Struggle-For-Power-In-The-994323.html>.⏎"The Struggle for Power in the Ussr." StudyMode.com. 0<|endoftext|>Afghanistan and Colombia, half a world apart and different in
-
Struggle-For-Power-In-The-994323.html⏎"The Struggle for Power in the Ussr" StudyMode.com. 05 2012. 05 2012
-
like during former days of jazz. This fusion of music was styled in a positive manner that made it overtake rap in early ‘90s (Keyes 245). With its objective being to spread hip hop to funs that
-
past two decades. The AFL and the CIO merged and formed one organization which represented “35% of all nonagricultural workers” (Foner 374).⏎Consumer Demand Spurs Economic Growth. Rising incomes, easy credit,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the user could have been thinking about in a different degrees of complexity: the user could have been thinking about in a different degrees of complexity: The following is the first one pithed by the user to the next one pithed by
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
240 pages | Cloth $55.00⏎American History / Women's Studies/Gender Studies⏎View main book page⏎Table of Contents⏎Chapter 1. Sleep Is for Sissies: Elite Males as Parag
-
interfering with activity in the RTPJ disrupts the capacity to use mental states in moral judgment, especially in the case of attempted harms.⏎Apr 16, 2010⏎Disruption of the right temporoparietal junction with
-
theory of intellectual development as the standard contemporary treatment of deductive reasoning is used as the context in which the contributors elaborate on their own perceptions.⏎Table of Contents⏎Contents: W.F. Overton, Competence and Procedures: Constraints on the Development
-
bittersweet truth about how taste works⏎Scientists have discovered an ion channel that allows taste buds to communicate with the brain.⏎Wed, Mar 06, 2013 at 03:20 PM⏎taste buds
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:2215 excites
- L9:117 suppresses
- L10:2748 weakly excites
- L9:2328 weakly excites
- L3:506 weakly excites
- L2:527 weakly excites
- L5:2640 weakly excites
- L7:1743 weakly suppresses
- L9:238 weakly excites
- L6:1993 weakly excites
- L8:2429 weakly suppresses
- L1:2342 weakly excites
- L6:806 weakly suppresses
- L3:2992 weakly suppresses
- L6:2217 weakly excites
- L10:2454 weakly excites
- L9:2082 weakly suppresses
- L4:2257 weakly suppresses
- L5:2501 weakly excites
- L9:2150 weakly excites
- L10:618 weakly excites
- L0:949 weakly suppresses
- L7:2354 weakly excites
- L2:132 weakly excites
Feeds later layers
- L13:2408 weakly excites
- L13:1513 weakly suppresses
- L16:2747 weakly excites
- L12:576 weakly suppresses 'of' in fixed phrases like table of contents
- L14:2180 weakly excites
- L17:2869 weakly suppresses
- L14:1103 weakly suppresses
- L14:2288 weakly suppresses
- L19:2241 weakly suppresses
- L13:2650 weakly suppresses
- L13:1622 weakly suppresses
- L26:377 weakly suppresses 'sh' starting a word piece
- L19:2277 weakly suppresses
- L22:1503 weakly suppresses
- L14:1015 weakly suppresses
- L21:3068 weakly suppresses
- L22:505 weakly suppresses
- L13:2085 weakly suppresses
- L13:780 weakly suppresses
- L16:1757 weakly excites
- L20:2961 weakly excites
- L19:1782 weakly suppresses end of document marker
- L27:322 weakly suppresses
- L21:1091 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ensed
- ียว
- artz
- elyn
- -sub
- .dtd
- =sub
- _HS
- ubs
- Sub
Suppresses
- 族自治州
- amphetamine
- роз
- 供大家
- 事實
- 经
- wort
- leigh
- データ
- NYSE