unclear: coordinating words in lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron is hard to pin down. It sometimes lights up on commas and 'or' or 'and' that join options in a list, but also on random words like a digit or a bracketed term. Turning it up made the model repeat 'and' and 'the' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
/or share your photos online.⏎A lot of online tutorials make it sound sort of scary, but it’s not. If you’re off a few (or 30) seconds or your water’s a couple degrees off temperature, you’re NOT
-
data:⏎We will work out the number of lego bricks needed in several step using a sequencing algorithm: An algorithm consisting of instructions that are carried out (performed) one after another.⏎We will use the following steps:⏎- Convert all measurement
-
this date remains on this date and is not moved to the following Monday. There has been much dispute in the past on whether weekends were on Friday and Saturday or Saturday and Sunday, so Sunday was established as the only day of rest and
-
closer zooms, you have more precision in placing the Measure tool end points.⏎If you want your measurements in strict alignment on the drawing’s vertical or horizontal (X or Y) axes, you might want to use the Horizontal measure or Vertical measure
-
ota? Also referred to as gut flora, it’s the collection of microorganisms found at any given moment in the gut – the small intestine and large intestine (colon). Our microbiota is in constant flux due to the life-cycle of these micro
-
’ theory on perception, the two philosophies bear some similarities on duality. For instance, they both believe in the existence of a body and a soul (mind).⏎There exist two different realities for every individual that lives; that which is physical
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
based on the total amount of cadmium – and not the amount extracted in a lab solution – is more health protective for children, more enforceable for government regulators, and less expensive
-
[SVG] How to draw a rectangle?⏎<svg height="210" width="500"> <polygon points="200,10 250,190 160,210
-
a major worldwide public health issue, resulting in over 13 million annual fatalities. The rise of novel illnesses, the resurgence of diseases that were previously under control, and the development of antibiotic resistance are all being influenced by changes in society, technology
-
of the human body, and as a result, dermatologists typically offer a wide variety of treatments for it.⏎Whether you wish to correct wrinkles, crepey skin, or razor bumps, a board certified dermatologist or dermasurgeon may help
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:473 strongly excites
- L16:1119 strongly suppresses
- L15:2054 strongly suppresses
- L15:2080 suppresses
- L16:774 suppresses
- L15:2277 suppresses
- L16:2183 excites
- L15:2737 suppresses
- L16:1141 excites
- L16:521 excites
- L15:1839 excites
- L15:1699 suppresses
- L16:2992 suppresses
- L16:565 excites
- L15:2440 excites word before 'and' or 'or' in pairs
- L15:60 suppresses
- L16:1928 suppresses
- L16:2922 excites
- L15:2912 excites
- L15:389 suppresses
- L16:2703 excites
- L15:989 suppresses
- L16:2649 suppresses
- L15:1078 excites
Feeds later layers
- L19:164 strongly suppresses
- L19:1605 excites
- L18:1207 excites
- L18:2341 excites comma before an added clause
- L20:1009 excites
- L21:393 excites unclear: relative 'that' and list items
- L26:347 excites the 're' in self-reliant and similar
- L18:851 excites
- L22:632 excites
- L20:610 excites
- L19:867 excites
- L25:6 suppresses
- L19:1414 excites
- L27:289 excites
- L23:379 excites
- L20:560 excites
- L18:619 excites
- L24:205 excites
- L19:1092 excites
- L27:358 excites
- L18:120 suppresses
- L18:1413 excites
- L19:1369 excites
- L19:1245 excites comma opening a list of parallel items
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 以及
- 或者
- and
- 性和
- および
- 和社会
- 或者是
- 和支持
- 文化和
- そして
Suppresses
- anker
- ervo
- 眄
- quer
- ву
- gett
- own
- ropol
- rella
- zar