comma after an intro phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that ends a short opening phrase and sets up the main sentence, like "To create an appropriate warning letter," in a how-to. Its negative side reacts to the start of words beginning with "Ext", such as "Extremist" or "Extinct". Turning it up gave repeated words like "moon", so the steering is not very informative.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
these problem-solving tools in action with a series of 3rd-grade problems based on the Singapore Primary Math series, level 3A. For your reading pleasure, I have translated the problems into the universe of a well-written biography of Ben Franklin
-
these threats and violences in multiple and intersecting ways. The deaths of Black women like Breonna Taylor, Sandra Bland, Regis Korchinski-Paquet, and others at the hands of the police cannot be forgotten. We acknowledge
-
the game boards.⏎- Attempt to explain to students how to properly pronounce and say dates in English:⏎Once you have got that beast of a task taken care of, simply tell the kids to play "sug
-
. But if a predator threatens, eggs may hatch early—and away run the lizards!⏎Ecologist Sean Doody discovered this while in the field with student Phillip Paull. The two were lifting eggs out of a crevice when . . .
-
for drug or alcohol abuse, suicidal thoughts or actions, problems at home or work, or deeper social withdrawal.⏎To beat SAD into the ground during the winter, fall,
-
apps have made their way onto most electronic devices, you might think there would be dozens of worthwhile products available on the topic designed for students. Think again.⏎Sure, there are plenty of apps devoted to November’s election, there just aren’t that
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: some people might not like the way the process is currently in hand, as it could lead to the finalization of some very influential, very influential, very influential, very influential, very influential, very influential, very influential, very influential,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and who openly condemn whites as evil personified, deserving only death or slavery,” the SPLC said.⏎Are they the guys yelling on street corners?⏎Sometimes. Extremist Hebrew Israelites can be found on street corners literally shouting their doctrine,
-
of the different hormonal activities in her body. Also, metabolism is boosted after menopause, thereby leading to hot flashes<|endoftext|>Our newest title⏎Busy with Bugs⏎Extremely Interesting Things
-
?⏎Modern Hebrew is the official language of the State of Israel, while premodern Hebrew is used for prayer or study in Jewish communities around the world today.⏎|Extinct||Mishnaic Hebrew extinct as a spoken language by the 5
-
. They have been reintroduced to National Reserves of Mongolia and China⏎CONSERVATION STATUS: Classified as Extinct in the Wild until 2008, but since a series of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2711 excites
- L23:1851 excites
- L18:2401 excites
- L17:2793 excites
- L21:2394 suppresses
- L20:2840 suppresses
- L22:992 excites
- L22:885 suppresses
- L19:1316 suppresses
- L23:1784 suppresses
- L22:1498 weakly excites
- L8:2681 weakly excites
- L5:26 weakly excites
- L23:298 weakly excites
- L18:126 weakly suppresses comma joining a full clause
- L22:1592 weakly excites
- L16:655 weakly excites 'see' cross-references and web boilerplate
- L6:1749 weakly excites
- L3:2147 weakly excites
- L15:152 weakly suppresses
- L20:122 weakly excites
- L16:348 weakly suppresses
- L17:218 weakly excites
- L17:845 weakly excites comma after an introductory phrase
Feeds later layers
- L27:1269 strongly excites
- L26:1080 excites
- L26:2360 weakly excites
- L27:1504 weakly excites
- L26:2198 weakly excites
- L26:2663 weakly excites
- L27:524 weakly excites
- L27:2429 weakly suppresses
- L27:2961 weakly suppresses
- L26:2537 weakly suppresses
- L27:2962 weakly suppresses
- L27:2370 weakly suppresses
- L26:186 weakly excites
- L27:1889 weakly suppresses
- L27:2377 weakly excites
- L26:1258 weakly suppresses
- L27:2167 weakly excites
- L27:2457 weakly excites
- L27:2502 weakly excites
- L26:74 weakly suppresses
- L27:2742 weakly excites 'w' inside split words
- L27:2666 weakly excites
- L27:1116 weakly excites
- L26:405 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- here
- here
- Here
- 在这里
- 这里
- Here
- 这里是
- HERE
- ici
- aquí
Suppresses
- ambda
- ourt
- processo
- 刘海
- FragmentManager
- ought
- możli
- 铿
- .getJSONObject
- UILD