commas after a clause or list item
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to commas that come after a phrase in the middle of a sentence, right before the writer adds an extra thought such as 'however' or 'moths and butterflies'. When turned up, the model began listing repeated items and phrases, and when turned down it produced stuttering, tangled sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
lings, from taking advantage of the house and evicting the wrens. Because wrens use a wide range of nesting material that can include larger twigs, however, a slightly larger entrance hole can be useful for the birds
-
long-lasting. Common symptoms may include:⏎- runny nose⏎- nasal and throat irritation⏎- aggravation of asthma⏎- allergic reaction⏎People with asthma, hay fever or other allergies could experience temporary respiratory symptoms when exposed to low amounts of
-
overwhelmed.⏎It is important to recognize when feeling overwhelmed is a sign of something more. Everyone feels overwhelmed from time to time, but if it’s affecting your health, seek help from a mental health professional or psychiatrist if needed.⏎In this blog post
-
important to understand what does — and does not — constitute ethical down. Learn more about ethical and unethical down production in the guide below.⏎Often found in outerwear, as well as comforters, pillows, and mattress to
-
strategy.⏎Although they are important for patient care, tissue biopsies—which may involve a large needle, an endoscope, or open surgery—can be invasive, risky, costly, and painful. And some patients may not be able to have
-
physics theory in easy steps, building concept on concept through humor, cartoons, funny stories and play.⏎By sequentially breaking down basic physical concepts into easy steps with cartoons, amusing illustrations, funny stories, stimulating experiments, and creative activities, ‘Fizzy
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have and and I and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Center at Oregon Health & Science University, monitored the reproductive systems of healthy female nonhuman primates following exposure to Delta-9-tetrahydrocannabinol, or THC, the main psychoactive ingredient in marijuana.⏎The nonhuman primates
-
grew cancer cells in the laboratory and found that leptin could stimulate their growth. In two out of three cell lines, leptin also blocked normal programmed cell death, apoptosis, which usually prevents runaway cell growth. When apoptosis fails normal cells can become
-
partition offset to attempt to achieve partition alignment.⏎Starting with these newer operating systems, the default partition offset is 1,048,576 bytes, exactly 1024 KB or 1 MB. This is a much
-
whose electrochemistry makes carbon capture appear nearly effortless. Their invention is a kind of battery: conductive electrodes coated with a compound called polyanthraquinone, which has a natural chemical attraction<|endoftext|>From: Michael Barrie <mibar
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:35 suppresses
- L17:118 excites comma after a clause ending
- L16:240 excites comma after 'sometimes' or 'the truth'
- L9:77 excites commas in citations and name lists
- L18:366 excites comma inside numbers and dates
- L15:588 excites comma after an introductory phrase
- L4:3 excites commas after citation fields
- L11:154 suppresses commas after citation numbers
- L5:16 excites
- L17:3025 suppresses
- L17:585 excites
- L10:335 excites commas in catalog, date, and list metadata
- L3:71 weakly suppresses
- L18:93 weakly suppresses
- L6:620 weakly suppresses "and" in lists of three or more
- L10:667 weakly suppresses commas inside lists of names
- L16:241 weakly excites
- L18:48 weakly suppresses
- L18:2863 weakly suppresses
- L18:2376 weakly suppresses
- L12:1557 weakly suppresses comma after an introductory phrase
- L13:1066 weakly suppresses
- L18:85 weakly suppresses
- L17:1575 weakly excites
Feeds later layers
- L20:1466 suppresses
- L20:1009 suppresses
- L21:1490 suppresses
- L20:513 suppresses
- L20:813 suppresses
- L24:205 weakly suppresses
- L22:144 weakly suppresses
- L25:895 weakly suppresses
- L21:1861 weakly suppresses
- L25:880 weakly suppresses comma after a cause or effect clause
- L20:930 weakly suppresses
- L25:16 weakly suppresses
- L20:2998 weakly suppresses
- L21:1807 weakly suppresses
- L21:1659 weakly suppresses
- L22:160 weakly excites
- L24:2099 weakly suppresses
- L21:720 weakly suppresses
- L20:955 weakly excites
- L22:4 weakly suppresses
- L22:820 weakly suppresses
- L21:359 weakly suppresses
- L20:1762 weakly suppresses
- L20:1732 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- yx
- ROID
- ポイント
- uncate
- silent
- ugen
- có
- ystal
- alus
- askets
Suppresses
- opers
- and
- 也就是
- 和发展
- altogether
- 要好好
- +')
- .firebaseapp
- 才算
- ome