comma after 'if' clause in prose, braces in code
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
In ordinary writing, this neuron fires on the comma that ends an 'if ... ' clause, just before the 'then' part of the sentence. Its opposite side fires on programming punctuation like braces and brackets. Turning it down made the model output repeated curly braces, which matches that code side.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
heaven, he wept on that migration and hence every child of Adam (as), weeps when he opens his eyes in this world. If this is true, then this reason for wailing certainly supports our point of view that in the grief
-
acceptable.⏎The skeptic seemed to be saying that if a certain behavior is found in the Old Testament narratives, and that behavior is not specifically condemned in those same narratives, then the narratives are teaching that this behavior is morally acceptable.⏎Is that how we
-
rum are specific approaches for Agile software development.” - Sam Newman (Building Microservices)⏎If microservices is about doing SOA (Service orientated architecture) well, it is probably worth looking at the SOA tenets:⏎- Services are autonomous
-
00 or 1000 experiments, then it is high probability that the hypothesis has been refuted.⏎If the hypothesis failed in their experiments, repeatedly, the scientist can do one of two things:⏎- He
-
and cause what are referred to as “cosmetic” skin cancers, but no direct evidence that it creates the deadly malignant melanoma.⏎If this were the case, then everyone who lives in the tropics<|endoftext|>
-
most open-source packages use this format to zip their files. If you are new to Linux or recently encountered the problem of unzipping the .tgz file, then you don’t have to worry this guide will teach you ways of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: { { { { { { { { { { { { { { { { { { { { { { { {
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
!⏎xs = [6, 9, 13, 42]⏎-- Without library⏎f :: Bool -> [Int]⏎f b = if b then xs else ⏎-- With library⏎g :: Bool -> [Int]⏎g
-
correcting the other code (too tired to check who it was that posted it, and I can't see just now anyway :P)⏎void genFactorial(int x, int t)⏎int total = t; // you probably wouldn't even need
-
- but look at the C++-tagged posts in this blog for examples of what the compiler thinks isn't a bad idea.)⏎if (x=0) init_subsystem();⏎So lots of books have been written about how to write code
-
as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++.⏎/* memchr example */⏎int main ()⏎char * pch;⏎char str = "Example string";⏎pch = (
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1084 strongly suppresses "and" joining clauses after a condition
- L20:122 strongly excites
- L16:2066 excites
- L16:1174 excites
- L20:2280 excites
- L15:725 suppresses
- L17:580 suppresses
- L18:1470 suppresses comma after an introductory phrase
- L16:2782 excites
- L17:243 suppresses
- L20:206 excites
- L17:1048 suppresses
- L11:237 suppresses
- L19:1979 excites
- L16:1838 excites
- L18:2139 suppresses
- L14:2194 suppresses
- L16:768 excites
- L20:2429 excites
- L18:1639 excites
- L16:1365 excites
- L16:669 excites
- L20:2274 excites
- L15:2295 suppresses
Feeds later layers
- L24:880 strongly suppresses
- L24:405 strongly suppresses
- L25:386 strongly suppresses
- L23:881 strongly suppresses
- L24:1443 suppresses
- L23:292 suppresses
- L27:1779 suppresses
- L25:1425 suppresses
- L27:967 suppresses
- L27:2506 suppresses
- L26:461 suppresses 'Sch' in surnames
- L22:1755 suppresses
- L27:1324 suppresses
- L27:1006 suppresses
- L27:1964 suppresses
- L25:2175 suppresses
- L23:221 suppresses
- L25:465 excites
- L25:255 suppresses pieces of split scientific or place names
- L25:865 suppresses
- L22:2197 weakly suppresses
- L27:860 weakly suppresses
- L26:1734 weakly suppresses 'the/as' before 'following'
- L25:769 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- abyrinth
- "};⏎⏎
- 辕
- },⏎⏎
- edium
- asion
- esters
- onta
- byter
- "};⏎
Suppresses
- {⏎
- ){⏎
- '){⏎
- }{⏎
- '){
- ){⏎
- {⏎
- { ⏎
- {⏎⏎
- "){