unclear: spots where text was removed
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The strongest examples are places where a word or phrase seems to have been blanked out or marked as missing, such as an empty bracket right before a gap. The pattern is hard to pin down. Turning it up led to repetitive text that did not clearly relate to this.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the air space with a soft polymer. The result was a continuous reinforced carbon nanotube composite.⏎“People have been working for more than ten years intensively [on carbon nanotube composites],” Suhr said. “Nobody had
-
far more effective at killing all cancerous cells than removing the entire breast.⏎Lead researcher Dr E Shelley Hwang, of the Duke Cancer Institute in <a class=”StrictlyAutoTagAnchor” title=”View all articles about North C<|endoftext|>What
-
in a school they believe did not support him.⏎Miyairi created the new anti-bullying program specifically to address these issues.⏎"It's important for [students] to understand the media messages and how our society views men and women,"
-
360 photos, edit them, design them and enhance the 360 space,” Ramnarine said. “Then [we] put those [photos] into virtual reality so you can experience the space after editing them.”⏎Other
-
1-day siege that included several gun battles with federal officers. Means died in 2012 at age 72.⏎“He was the only person in (a) leadership position in Wounded Knee who never left Wounded Knee,
-
behavior is easy. It’s maintaining change that’s hard—creating new and sustained ways of thinking and behaving. As Mark Twain quipped, “Quitting [smoking] is easy, I’ve done it dozens of times.” Many can
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am trying to write something about the things I want to do next time I feel something similar to a feeling of something specific. I want to write something that is specific and vivid' and I want to make it vivid' and specific'
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
32K).⏎GLib (pronounced ``gee-lib'') shared libraries are a way to implement shared libraries on the Pilot that differs from the ``standard'' (SysLib) mechanism for the Palm Pilot.⏎Some features of GLib
-
, and the University of Colorado. UC Davis’s press release explains that the chemical’s effects are so striking that the study “provides strong evidence that triclosan could have effects on animal and human health at
-
free-market fundamentalism has become not only a much-vaunted ideology that now shapes all aspects of life in the United States but also a predatory global phenomenon “that drives the practices and principles of the International Monetary Fund, the World Bank, and
-
Atmospheric Administration have concluded that Louisiana is in line for the highest rate of sea-level rise “on the planet.” * Indeed, the water is rising so fast that some coastal restoration
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:1388 strongly excites
- L9:632 strongly suppresses
- L6:174 excites
- L6:120 excites
- L9:982 suppresses
- L3:10 excites
- L7:100 suppresses
- L7:574 suppresses
- L7:732 excites
- L3:33 suppresses
- L2:240 suppresses
- L9:2249 suppresses
- L4:1861 suppresses
- L4:1005 suppresses
- L9:1376 weakly suppresses
- L4:2293 weakly excites
- L8:1380 weakly excites
- L4:327 weakly suppresses
- L1:102 weakly excites
- L6:80 weakly excites
- L0:649 weakly excites
- L1:122 weakly suppresses 'World War II' and the 'II' after 'War'
- L6:599 weakly suppresses
- L1:155 weakly suppresses
Feeds later layers
- L15:650 strongly suppresses
- L19:471 strongly suppresses
- L17:371 strongly suppresses
- L16:332 strongly suppresses plural '(s)' in parentheses
- L17:238 strongly suppresses
- L13:3050 suppresses
- L18:1705 suppresses
- L11:1579 excites
- L24:114 suppresses
- L19:671 suppresses
- L18:678 suppresses
- L19:588 suppresses
- L23:288 suppresses
- L20:540 suppresses
- L14:220 suppresses
- L15:2795 suppresses
- L14:428 suppresses
- L20:654 suppresses
- L21:210 excites
- L24:785 suppresses
- L12:2021 suppresses
- L25:372 suppresses
- L23:260 suppresses
- L14:1142 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- "${
- ⏎⏎⏎⏎⏎⏎⏎⏎⏎
- 分明
- `_
- “
- ⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎
- 、“
- ⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎⏎
- ⏎⏎⏎⏎⏎⏎⏎⏎
- (`
Suppresses
- 」と
- 》
- "},
- "}
- ”的
- 」
- ",
- ”。⏎⏎
- '",
- "]