comma after month and day
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that comes after a month and day in a news dateline, such as 'Dec. 7, 2005'. Turned down, the model drifted into talk about prime ministers and government. Turned up, the output was not clearly related.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
audio⏎OAK RIDGE, Tenn., Dec. 7, 2005 — Forest productivity may be significantly greater in an atmosphere enriched
-
when the family moved to the U.S.⏎The<|endoftext|>NASA asks future explorers to respect historic landing sites⏎By David Szondy⏎May 27, 2012⏎When the last American astronauts blasted off from the Moon
-
in the journal The Plant Cell, opens the door to the engineering of plant clock systems, with powerful applications to agriculture.⏎(PRWeb UK) March 17, 2010 -- Researchers at the RIKEN Plant Science Center have
-
Capital News – Dec. 3, 2017);⏎- “Icy road leads to crash” (
-
Mars Rover Curiosity: Mars Science Lab Coverage⏎- 1st Photos of Mars by Curiosity Rover (Gallery)⏎Copyright 2012 SPACE.com, a TechMediaNetwork company. All rights reserved. This material may not
-
rover Curiosity makes historic Mars landing, beams back photos⏎Irene Klotz Reuters⏎12:17 p.m. EDT, August 8, 2012⏎PASADENA, California (Reuters) –
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of the prime number 1000, the number of the prime number 1000000, and the number of the prime number 10000000. The number of the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Nuclear Power Station in the wake of the natural disaster, leading to concerns of a potential nuclear catastrophe, according to the U.S. Nuclear Regulatory Commission.⏎The Department of Energy has sent two experts to Japan -- an emergency response representative and a nuclear engineer
-
crisis of 1973/74 that ended the "economic miracle" once and for all. By the time Herbert Grünewald succeeded Kurt Hansen as Management Board Chairman following the 1974 Annual Stockholders' Meeting,
-
own communities, and resolve once more to advance religious freedom in our time.⏎Melissa Rogers, a widely respected advocate for religious liberty who currently serves as special assistant to the president and executive director of the White House Office of Faith-based and Neighborhood Partners
-
the Civil Rights Act turning 50, the success of the struggle for equal rights for women and minorities<|endoftext|>The No Child Left Behind Act, signed into law by President Bush January 8, 2002 includes as one of its
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2169 excites
- L3:933 suppresses
- L10:3006 weakly excites
- L8:1741 weakly suppresses
- L11:3056 weakly suppresses
- L20:1474 weakly suppresses
- L20:2605 weakly suppresses
- L20:253 weakly excites
- L3:2066 weakly excites
- L1:94 weakly suppresses
- L9:2295 weakly suppresses
- L8:2224 weakly suppresses
- L18:1762 weakly excites
- L20:525 weakly excites
- L6:2535 weakly suppresses
- L20:115 weakly suppresses
- L13:2682 weakly suppresses
- L4:1137 weakly suppresses
- L18:468 weakly excites
- L17:1857 weakly excites
- L6:2330 weakly suppresses
- L8:2939 weakly suppresses
- L20:520 weakly suppresses
- L17:1108 weakly excites
Feeds later layers
- L23:2987 weakly suppresses
- L22:1661 weakly suppresses
- L27:863 weakly suppresses
- L22:2201 weakly suppresses
- L23:2845 weakly suppresses
- L22:1577 weakly suppresses
- L27:2781 weakly suppresses
- L22:593 weakly suppresses
- L27:3039 weakly suppresses
- L23:2039 weakly suppresses
- L22:2988 weakly suppresses
- L22:921 weakly excites
- L22:2950 weakly suppresses
- L22:705 weakly suppresses
- L25:1536 weakly suppresses
- L23:748 weakly suppresses
- L25:2000 weakly suppresses
- L22:2129 weakly suppresses
- L23:1728 weakly excites
- L25:1204 weakly excites
- L25:2851 weakly suppresses
- L23:954 weakly suppresses
- L22:1030 weakly suppresses
- L22:133 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Bloody
- funnel
- 获利
- ampie
- ;break
- máu
- uffer
- getResource
- halo
- ран
Suppresses
- prime
- Prime
- Prime
- ministers
- Ministers
- Min
- Secretary
- [min
- prime
- 会长