semicolons joining two clauses
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on semicolons that join two related sentences, especially in technical or translated-sounding text. It also dips on the 'ze' in 'Yangtze'. Turning it up or down did not produce a clear theme in the sample text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
brushless DC motor is a single chip microcomputer control, commutation and commutation: position sensor output signal, through the software, control word control P1; Speed change: PWM control armature current; Current limiting control: voltage comparator.⏎
-
ountains are generally suitable for meeting places such as squares. It is an organic combination of music, water shape, and light to give people a visual and auditory beauty; at the same time, the
-
also integrated drive circuit.⏎Suitable for a certain speed but not high speed accuracy requirements of the field, such as fans, pumps, hair dryer and other applications; And most industrial control and automatic control applications, such as mixers, plasma processors
-
DC0 ~ 10v) interface and digital (serial transmission) interface. The analog interface is driven by a frequency converter and a three-phase asynchronous motor; the digital interface is controlled by a fully digital servo motor. Generally speaking, the
-
layer thickness, quality and uniformity; and it can be used to deposit a variety of different materials in thicknesses ranging
-
Jewish perspective, visiting Jewish historical sites in post-Holocaust, post-Communist Europe can be a very positive experience, emphasizing Jewish life, history and culture; but the experience also falls under what is now known as Dark Tourism—tourism
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the 20th century. 1990. 1991. 1992. 1993. 1994. 1995. 1996
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, 2011) A study by seismologists at the China Seismological Bureau indicates that the massive Three Gorges dam on the Yangtze River caused a “significant” increase in seismic activity along the dam’s reservoir.⏎
-
smog. The affected cities, which include the capital Beijing, are located in the regions of Beijing-Tianjin-Hebei and of the northern Yangtze River delta - including the Jiangsu province - , as well as in the Fen
-
for Beijing.⏎(May 19, 2011) The world’s largest hydroelectric project was designed to tame the flood-prone Yangtze River and to generate clean energy
-
responsibility for the Third World’s debt crisis on the parties involved, instead of on First and Third World taxpayers. Pat also edited the English language translation of Yangtze! Yangtze!, the extraordinary critique by Chinese experts of the Three Gorges
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:23 suppresses
- L3:672 excites
- L3:1216 weakly suppresses
- L3:130 weakly excites
- L3:294 weakly excites
- L3:1264 weakly excites
- L1:1547 weakly excites
- L2:609 weakly suppresses
- L3:249 weakly excites
- L3:2118 weakly excites
- L1:162 weakly excites
- L1:1594 weakly suppresses
- L3:50 weakly excites
- L3:691 weakly excites
- L1:2810 weakly suppresses
- L3:615 weakly suppresses
- L2:1899 weakly excites
- L2:377 weakly excites
- L1:699 weakly excites
- L3:113 weakly suppresses
- L0:776 weakly excites
- L0:1301 weakly suppresses
- L2:1613 weakly suppresses
- L2:2831 weakly excites
Feeds later layers
- L7:920 weakly suppresses
- L6:1121 weakly excites 'while' joining two clauses after a comma
- L18:69 weakly excites
- L19:2457 weakly excites
- L6:1630 weakly excites
- L15:2681 weakly suppresses
- L11:2003 weakly excites
- L6:973 weakly suppresses
- L12:1139 weakly excites
- L5:2626 weakly suppresses
- L5:315 weakly suppresses
- L7:2794 weakly suppresses
- L5:1584 weakly suppresses
- L5:939 weakly suppresses
- L6:255 weakly suppresses
- L27:845 weakly suppresses
- L9:1604 weakly suppresses
- L24:536 weakly suppresses
- L6:1817 weakly suppresses
- L25:2345 weakly suppresses
- L14:1614 weakly suppresses
- L7:2379 weakly suppresses
- L16:2463 weakly suppresses
- L12:1853 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ollipop
- engl
- олос
- uellement
- ivable
- 可观
- icrous
- lename
- kịch
- ueil
Suppresses
- ılmış
- IOUS
- d
- UNG
- stitute
- YS
- poverty
- IA
- specific
- INATION