'in' after a named author or speaker
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "in" right after a person's name or a statement verb, as in "wrote in" or "said in", where a source or publication is about to be named. Turning it up did not produce a clear visible change in the stories.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
have properties that increase diabetes risk independently from obesity.⏎The study was the icing on the cake for theories that sugar is toxic. As columnist Mark Bittman wrote in The New York Times:⏎The study demonstrates [that sugar causes diabetes] with the
-
JUNE 22, 1970, President Nixon extended the Voting Rights Act to let 18-year-olds vote.⏎The Supreme Court, in Oregon v Mitchell, limited this right so the 26th Amendment was passed
-
although Cox asserts that he and the physicists at CERN will prove or disprove their existence by 2017. However, as Anthony Kaufman writes in his review on the
-
if you have fibromyalgia.⏎Dr. Jim Sublett, chief of allergy immunology at the University of Louisville School of Medicine in Kentucky has repeatedly said in literature that over-the-counter remedies can have adverse side effects.⏎The side effects
-
every nation on the planet, and demonstrated Earth’s gravity need not prevent humanity from exploring the entire universe, US-based Space Foundation CEO Tom Zelibor had said in April.⏎On April 12, 1961, Gagar
-
riveting story of the two crusading lawyers who led the legal battle to end segregation, one case and one courtroom at a time.⏎The Supreme Court’s decision inBrown v. Board of Educationis widely considered a seminal point in the battle to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's a function of the number of times I have been given the same amount of money. So, I have been given the function of the number of times I have been given the same amount of money. This is a function of the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
permitting it for research done on existing stem cell lines, that is, stem cell lines created from embryos that have already been destroyed. The following is reprinted with permission from The Chicago Jewish News.⏎Pikuach nefesh. Preservation of life.
-
the overarching story formed from controlling stories within a culture. He argues that metanarrative is the basis for worldview core assumptions about all of reality. Matthews borrows from Michael Kearney who understands worldview to be the encompassing assumptions about: self
-
Hydrological Society⏎This article has been published in Journal of Hydrology (NZ). © 1995 The New Zealand Hydrological Society. Used with permission.<|endoftext|>A group at Lawrence Livermore National Laboratory that predicts the spread of hazardous
-
in children: time trend analysis. BMJ. August 6, 2005;331:328–9.⏎Used with permission from
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:2358 suppresses
- L5:898 suppresses
- L5:353 weakly suppresses
- L5:26 weakly excites
- L5:2261 weakly excites word pieces inside medical and science terms
- L2:2668 weakly excites
- L5:1512 weakly excites
- L5:141 weakly excites
- L3:407 weakly excites
- L2:2414 weakly suppresses
- L1:1353 weakly excites
- L4:560 weakly suppresses
- L3:1488 weakly suppresses
- L0:2420 weakly suppresses
- L1:2180 weakly excites
- L0:2414 weakly excites
- L4:1035 weakly excites 'for' after verbs like 'fall' or 'click'
- L2:2503 weakly excites
- L0:372 weakly suppresses
- L4:1153 weakly suppresses
- L0:2233 weakly suppresses
- L0:951 weakly suppresses
- L5:1323 weakly excites
- L3:125 weakly excites verb right after a subject in clauses
Feeds later layers
- L7:2571 excites
- L7:2492 weakly excites
- L9:1873 weakly suppresses
- L12:1288 weakly excites
- L8:886 weakly excites
- L11:1699 weakly excites
- L11:1765 weakly excites
- L8:675 weakly excites
- L10:1832 weakly suppresses
- L12:2632 weakly excites
- L7:2369 weakly excites comma or 'to' before a quotation
- L12:920 weakly excites
- L12:2088 weakly excites
- L10:935 weakly suppresses
- L7:528 weakly excites
- L13:1251 weakly excites
- L12:1086 weakly excites
- L10:2770 weakly suppresses
- L15:1963 weakly excites
- L13:1349 weakly suppresses
- L11:1231 weakly excites
- L20:2273 weakly excites
- L7:198 weakly suppresses
- L7:1416 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- directives
- 文中
- 窑
- asco
- yet
- .onNext
- 深度
- Cups
- 倾
- back
Suppresses
- имя
- idental
- _);⏎
- etchup
- _); ⏎
- oteca
- ENCH
- chooser
- ocha
- uspend