"in" after a publication or study word
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "in" when it comes right after a study, article or publication, as in "published in" or "article in" a journal. When it was turned up, the model's writing did not become noticeably related to journals or studies.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
figure wasn’t statistically significant.⏎“Even total mortality went in the right direction,” said Gaziano, whose new data comes from the Physicians Health Study II published Wednesday in the Journal of the American
-
fetal genetic testing extend beyond the health of a baby to screen for desirable physical and mental traits?⏎A recent study conducted by the Georgetown University Medical Center in Washington published in Genetics in Medicine, found that 70 percent of health care practitioners surveyed had
-
the current recommendation for five years, say researchers.⏎University of Oxford scientists say the doubling cuts both the risk of the cancer returning and deaths from the disease.⏎Writing in The Lancet, they say this outweighs the risk of side effects.⏎C
-
children under 10 years of age and women had a lower incidence of infection than adolescents or adults and men.⏎As the researchers wrote in their study on Tuesday in the New England Journal of Medicine, COVID-19 was first diagnosed in Iceland
-
.⏎- Excellent cutting surface roughness can be produced even when machining at low speed.⏎- Suitable for soft materials or workpieces<|endoftext|>Fernanda vertelt haar verhaal in een gesprek met CSL Behring⏎Living With Alpha
-
53 days, using a carefully selected array of instruments to peer deeper into the planet than ever before.⏎The most recent findings from these measurements have now been published in a series of papers, revealing the three-dimensional structure of Jupiter’s weather systems—including
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Justimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimatelyimately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
λόφῳ in Einklang zu bringen, ist es unumgänglich nothwendig dass der Ausdruck Roma quadrata technisch in doppeltem Sinne gebraucht wurde; einmal zur Be
-
tasks for small-, mini- and micro-satellites.<|endoftext|>Until 1864, Georgia had been barely touched by the war. The Confederate victory at Chickamauga in 1863 had seen off a previous Union invasion
-
control of the Chesapeake Bay from the British, victory by the American and French armies at Yorktown would have been impossible. Without the French victory at the Battle of the Capes, American independence from Great Britain might never have been achieved.⏎With
-
several times and Washington stopped over at the Hartsville Inn on several occasions, traveling between Philadelphia and Coryell's Ferry (New Hope). The action of the Battle of Crooked Billet took place just south of the Borough; the territory of what
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L25:247 excites
- L20:593 excites
- L18:2153 weakly suppresses
- L20:64 weakly suppresses
- L21:310 weakly excites
- L19:948 weakly suppresses
- L13:2416 weakly excites
- L22:171 weakly excites
- L21:852 weakly excites
- L23:373 weakly excites 'to' after a noun or adjective
- L18:861 weakly excites
- L23:128 weakly excites 'for' as in 'for example'
- L4:4 weakly suppresses
- L19:1305 weakly suppresses unclear: verbs after a noun or 'that'
- L22:353 weakly suppresses
- L8:328 weakly suppresses
- L20:219 weakly suppresses "the" after time or place prepositions
- L23:1802 weakly suppresses
- L6:388 weakly excites
- L18:131 weakly suppresses
- L15:267 weakly excites
- L3:962 weakly suppresses
- L15:1304 weakly suppresses
- L22:2991 weakly suppresses
Feeds later layers
- L27:647 strongly excites
- L27:994 weakly excites
- L27:149 weakly excites
- L27:854 weakly excites
- L27:3052 weakly suppresses
- L27:2770 weakly excites
- L27:734 weakly excites
- L27:2731 weakly excites
- L27:108 weakly excites
- L27:2655 weakly excites
- L27:1357 weakly excites
- L27:2876 weakly excites
- L27:2204 weakly excites
- L27:2365 weakly suppresses
- L27:2404 weakly suppresses
- L27:2779 weakly suppresses
- L27:59 weakly excites full stops in running text
- L27:1358 weakly suppresses
- L27:2034 weakly excites
- L27:1856 weakly excites
- L27:2962 weakly excites
- L27:2957 weakly suppresses
- L27:1325 weakly suppresses
- L27:1638 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- The
- The
- >The
- →The
- nThe
- .The
- THE
- (The
- "The
- :The
Suppresses
- imately
- toMatch
- みると
- inness
- EntityState
- #endregion
- der
- ⏎ ⏎
- webElementProperties
- ymoon