comma joining a full clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that follows a complete statement and sets up an extra explanation, such as 'a decision based on a feature, and it leads to...'. It was quiet or negative on words that end a phrase right before a bracket or an aside, like 'F' or 'implies'. Turning it up or down gave loose, repetitive text with no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. The root node represents the top of the tree, and it contains all the instances or data points. Each branch represents a decision based on a feature or attribute, and it leads to a child node. The child node contains the instances that were
-
developed a tiny, $0.20 temperature sensor that didn’t require a battery or constant source of wired electricity. 3D printing isn't new either, and already, researchers can print out human organs using biological "ink".⏎The UW
-
as developers navigate through various programming languages and frameworks to create powerful and intuitive applications.⏎The Significance of Coding in App Development⏎Coding is the backbone of app development, allowing developers
-
at the top of your screen near the toolbars. Then right-click and select AutoCAD. A long list should show up, displaying various toolbars containing different commands. The most popular toolbars that are used
-
produce economic benefits through the jobs they provide and the products they produce. There is no way I can catalog all those benefits. No single statistic can do them justice, but the following may give some idea of their scale: data on the amount of
-
color to highlight or downplay certain features of your outfit.⏎Pattern is another key element of fashion. Patterns can range from bold and graphic to subtle and understated,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
if they’re given time to acclimate to the warmer weather, that temperature raises slightly, to 37.6° C (99.7° F). You might recognize that
-
b. (of two or more attributes of an object) unable to belong to the object simultaneously; inconsistent.⏎5. (of positions, functions, ranks, etc.) unable to be held simultaneously by one person.⏎6. Med.of or pertaining
-
would ultimately be approved. In other words, as of the date of this writing, it is still illegal to kill goliath grouper.⏎As its name implies, the Goliath Grouper
-
are also many approximate conservation laws, which apply to such quantities as mass, parity, lepton number, baryon number, strangeness, hypercharge, etc. These quantities are conserved in certain classes of physics processes, but not in
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:417 excites
- L8:27 excites
- L17:1772 excites
- L14:1142 suppresses
- L17:845 suppresses comma after an introductory phrase
- L7:8 suppresses
- L6:228 suppresses comma after a filler word
- L16:558 suppresses
- L6:429 excites
- L16:180 suppresses
- L8:187 suppresses
- L17:432 excites
- L14:177 suppresses
- L17:1548 suppresses
- L16:1545 suppresses
- L17:2706 excites
- L8:32 suppresses
- L16:509 suppresses
- L14:830 excites
- L6:296 excites
- L14:220 suppresses
- L10:182 suppresses
- L7:701 excites
- L17:347 suppresses full stops ending informative sentences
Feeds later layers
- L19:384 suppresses
- L19:204 excites
- L19:909 suppresses
- L19:278 excites
- L20:2 suppresses
- L20:317 excites
- L20:382 suppresses
- L19:2683 suppresses
- L19:94 excites
- L20:95 suppresses
- L19:272 excites
- L20:271 excites
- L19:330 suppresses
- L20:660 suppresses
- L19:695 excites
- L20:245 suppresses
- L21:99 weakly excites
- L19:1072 weakly suppresses
- L19:270 weakly suppresses
- L19:719 weakly suppresses
- L23:335 weakly suppresses
- L20:252 weakly suppresses
- L21:639 weakly suppresses
- L19:36 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- t
- acman
- f
- addy
- wares
- ll
- communicator
- 为自己
- ling
- 색
Suppresses
- '): ⏎
- "): ⏎
- ��态
- ')['
- %");⏎
- '):⏎
- )::
- '), ⏎
- .'); ⏎
- '):