commas and 'and' in noun lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the commas and 'and' that separate items in a list of things, like 'cutting patterns, and hand writing' or 'fish, chemistry, and physics'. Turning it up made the writing fall into repetitive lists, though not clearly the same kind of list.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, students can compare trends that occur based⏎upon certain variables. Even the death of a fish is an opportunity to⏎address and discuss possible causes, preventions and ways to improve⏎Biology, chemistry, ecology, and physics are just a
-
continue to grow, such as writing, tying shoes, typing and so much more⏎2)Fine Motor Coordination– In order to draw shapes, cut patterns, and hand writing, your child is required to use their fine motor coordination. These
-
Electronic Devices⏎3 – Alternating Current (AC) Fundamentals⏎4 – DC and AC Power⏎5 – Power Factor⏎6 – Demand, Load Factor, Service Factor and Electrical Power Bill Computation⏎7 – Electric Motors and Generators
-
ers, along with a Universal Primer that binds to the universal tag sequence will amplify specific<|endoftext|>Create a free profile to get unlimited access to exclusive videos, sweepstakes, and more!⏎It’s difficult to describe the immensity of galaxy clusters; they
-
they meet the required specifications.⏎<|endoftext|>RASPBERRY Pi - LEARNING HOW TO MAKE YOUR ROBOT WORK⏎ANTICS - ARDUINO - ARMOUR - ARTWORK - BIOLOGY - BLACK BOX - COMPUTERS - ELECTRONICS -
-
the product, check<|endoftext|>Help support New Advent and get the full contents of this website as an instant download or CD-ROM. Includes the Catholic Encyclopedia, Church Fathers, Summa, Bible and more all for only $19.99...⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Can this argument have? An example? A very good one? Such? A very good argument? A very good argument? A very good argument? A very good argument? A very good argument? A very good argument? A very good
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and maintaining copyrights, netiquette, privacy, and user responsibility.⏎Books & Booklets; Internet Resources⏎Administration & Leadership⏎Administrator, Teacher, Board Member / Trustee<|endoftext|>This post is Day 3 in a series of studies about “
-
⏎Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop Make
-
evidence that vitamin D reduces the risk of viral infections. Influenza is more common in winter for two reasons: cold temperatures and low solar UVB doses and vitamin D production. A randomized controlled trial on Japanese school children found that those taking
-
1) The dominator⏎Establish procedure to ensure equal participation.⏎Interrupt and ask to summarise⏎Thank the person and hear from others in the group⏎(2) The shy person⏎-use ice-breakers to make them comfortable. Get them
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:705 excites
- L10:1953 suppresses
- L7:163 suppresses
- L10:2518 suppresses
- L10:597 suppresses
- L8:512 excites
- L7:333 excites
- L10:1090 weakly suppresses
- L8:558 weakly excites
- L8:2576 weakly suppresses
- L8:1645 weakly excites
- L7:821 weakly excites
- L10:3020 weakly excites
- L8:719 weakly excites
- L8:195 weakly suppresses
- L4:276 weakly excites
- L7:406 weakly suppresses
- L9:1656 weakly excites
- L7:323 weakly suppresses
- L3:377 weakly suppresses
- L10:1171 weakly excites
- L1:1559 weakly excites
- L9:1374 weakly suppresses
- L7:303 weakly suppresses
Feeds later layers
- L12:1585 suppresses
- L12:1937 suppresses
- L13:758 excites 'and' joining a pair of options
- L14:1335 excites
- L13:517 excites comma closing a list item
- L12:959 excites
- L15:1708 excites
- L16:492 suppresses
- L14:1159 suppresses
- L15:217 weakly suppresses
- L12:2726 weakly suppresses
- L16:2733 weakly excites
- L15:545 weakly excites
- L12:749 weakly suppresses
- L16:1388 weakly excites
- L13:977 weakly excites
- L13:125 weakly excites
- L14:345 weakly suppresses
- L13:1821 weakly excites
- L12:1209 weakly suppresses
- L13:1533 weakly excites
- L16:1294 weakly excites
- L12:690 weakly excites
- L13:1462 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- icans
- orous
- iated
- )'),⏎
- Near
- )||(
- tık
- ktop
- agi
- edelta
Suppresses
- 水平
- プリ
- ích
- StringUtil
- _FRAGMENT
- Serialization
- SRC
- level
- 动生成
- 车上