Chinese commas and list separators
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on commas in Chinese text (the Chinese comma and list separator), and sometimes on English commas that come before a second clause. It is a comma detector, mostly in Chinese sentences. Turning it up made the model write in a loose, rambling style.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Pre-test)”的已达到83.3%,说明对比分析的研究成果对泰国学生学习汉语助动词具有较大的帮助,学生能更容易、更好地把握汉语助动词的语义、语法功能与特点。aux
-
中具有较大的作用,使用率高,但是泰国学生经常在学习和使用汉语助动词中产生各种的偏误。本文通过调查法、统计
-
.⏎Cleaner uniforms must be equipped with appropriate personal protective equipment, such as gloves, water shoes, dust masks, etc., which can not only improve work efficiency, but also reduce or avoid occupational hazards for cleaners.⏎It can avoid the breeding and
-
Fire tube boilers — Biomass boilers; Bubbling fluidized bed boilers; Circulating fluidized bed boilers⏎- Front<|endoftext|>CNY - 中國元,人民幣⏎最常用 CNY 交叉匯率⏎為什麼您
-
capitalist society, all human relationships are voluntary. Men are free to cooperate or not, to deal with one another or not, as their own individual judgments, convictions, and interests dictate. They can deal with one another only in terms of<|endoftext|>School
-
the software of the servo system hardware. There is a greater improvement. The drive components have evolved from the early thyristor SCR, high power transistor GTR, etc. to the current smart power device IPM.⏎In the analog AC servo
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I know, I know, " the "s, " " (2145, 2145, 2145, 2145, 2145, 214
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
221BC). Unlike most Chinese idioms, 毋忘在莒 strangely has actually two stories of origin, which gave this idiom two
-
buried alive. This phobia peaked in the 18th and 19th centuries when epidemics of yellow fever and cholera commonly killed thousands and thousands of people. This fear was not totally unfounded. An Englishman, William
-
.⏎“People normally<|endoftext|>Spring Dawn by Meng Haoran 春眠不觉晓 处处闻啼茑 夜来风雨声 花落知多少⏎Pin Yin Version Chun mian bu jue xiao Chu chu wen ti
-
法、分析法来进行研究,探讨泰国学生在学习汉语助动词中的困难及偏误
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:155 strongly excites
- L13:44 strongly suppresses inside web addresses and citations
- L11:223 excites
- L2:24 suppresses
- L7:92 excites
- L4:76 excites
- L8:328 excites
- L3:130 excites
- L5:7 suppresses
- L10:370 suppresses
- L4:342 suppresses
- L12:158 suppresses
- L1:699 excites
- L9:17 suppresses
- L1:25 excites
- L10:669 suppresses
- L9:74 excites
- L11:840 suppresses
- L4:92 suppresses
- L9:207 weakly suppresses
- L4:42 weakly suppresses
- L7:72 weakly excites
- L10:1289 weakly suppresses
- L10:873 weakly excites
Feeds later layers
- L17:740 excites
- L18:1103 excites
- L16:995 excites
- L18:126 suppresses comma joining a full clause
- L17:472 weakly excites
- L16:797 weakly suppresses
- L25:2797 weakly excites
- L18:861 weakly excites
- L17:1756 weakly excites
- L17:1772 weakly excites
- L20:822 weakly excites
- L22:654 weakly excites
- L26:25 weakly suppresses
- L16:28 weakly suppresses
- L22:669 weakly excites
- L18:276 weakly suppresses
- L17:2008 weakly excites
- L19:1966 weakly excites
- L18:1842 weakly excites
- L19:2759 weakly excites
- L16:1142 weakly excites
- L27:2038 weakly excites
- L21:33 weakly suppresses
- L18:902 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- iversary
- 一回事
- 他们在
- úa
- arded
- heels
- rove
- 如果是
- 淹没
- emente
Suppresses
- ,
- ред
- (⏎
- comm
- [⏎
- (
- �
- Agent
- migration
- saying