comma opening an aside or explanation
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that comes right after a noun and introduces an explanation, such as "a laparoscope, a viewing instrument" or "managing pollution, with the end goal." Turning it up made the model drift into long, repetitive lists, which does not clearly relate to the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
a lid on pollution.⏎WiseGeek has one of the clearest definitions of Cap and Trade: A cap and trade system is a method for managing pollution, with the end goal of reducing the overall pollution in a nation, region, or
-
the vagina, your healthcare provider can see the cervix and the inside of the uterus.⏎- Laparoscopy. This minor procedure uses a laparoscope, a viewing instrument with a light, to see your uterus and pelvis. The
-
ier blood sugar levels and sustained energy. Also, complex carbohydrates tend to provide more vitamins and minerals than sources of simple sugars.⏎Sugar has its place in your diet, but many health and diet experts warn that excess sugar consumption can lead to several serious
-
Earned Income Tax Credit, among others, are essential for keeping millions of women and families above the poverty line. We know that women disproportionately rely on these programs, making the message from the state poverty data clear: Programs for low-income families and
-
the denominational groups. This study was informed by Baumrind's parenting styles and Mowder's parent development theory (PDT) to examine parenting factors, including parenting styles, perceptions of the parent role, and individual religiosity, across
-
is one of those strange grammatical expressions that strikes fear into the best of us. The truth of the matter is that one of the challenges of learning a language, be it Spanish or any other, is actually understanding your own grammar.⏎We have
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The question is, what do we have in the story, the characters, the plot of the story) that is important to that, the story is not, the story is not, the story is not, the story is not, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
management|⏎Class 10 Science Chapter 4 Environmental management questions answers in Pdf format:⏎Here is what you all are waiting for. Teachers, parents and student, now you will find below the Solutions of Class 10 Science Chapter 4
-
of protein. It also gives details per 100g: 3.2g of protein. Aha! I could - if I needed to, figure out how much a portion weighs using proportion! It’s time for the Table
-
Ann Wright: Deer in the garden⏎In the first volume of “Deer in My Garden”, beloved local garden guru Carolyn Singer wrote, “’Grandma, why don’t you grow yucky flowers?’ ‘Why would I do that,
-
reading this topic⏎0 members, 0 guests, 0 anonymous users<|endoftext|>The JCTC applauds the action by the FDA to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:35 strongly suppresses
- L11:154 suppresses commas after citation numbers
- L9:77 excites commas in citations and name lists
- L4:3 excites commas after citation fields
- L5:16 excites
- L15:588 excites comma after an introductory phrase
- L15:630 suppresses
- L14:51 excites colon that introduces a statement
- L15:123 suppresses
- L12:1557 suppresses comma after an introductory phrase
- L3:71 suppresses
- L13:1066 suppresses
- L10:74 suppresses
- L10:667 suppresses commas inside lists of names
- L15:1213 suppresses
- L6:620 weakly suppresses "and" in lists of three or more
- L12:5 weakly excites
- L15:217 weakly excites
- L0:146 weakly suppresses
- L10:335 weakly excites commas in catalog, date, and list metadata
- L10:1459 weakly suppresses
- L14:1237 weakly suppresses
- L13:131 weakly suppresses 'and' joining parallel phrases
- L10:1643 weakly excites
Feeds later layers
- L17:2787 excites comma after 'that' or a verb before an aside
- L18:366 excites comma inside numbers and dates
- L25:880 excites comma after a cause or effect clause
- L17:3030 excites
- L22:144 excites
- L17:1841 excites
- L17:642 suppresses
- L19:2403 excites comma after a full clause
- L17:118 excites comma after a clause ending
- L18:1394 excites
- L19:2836 excites
- L20:513 weakly excites
- L18:2863 weakly excites
- L23:184 weakly excites
- L27:1354 weakly suppresses
- L20:1466 weakly excites
- L21:1541 weakly excites
- L25:306 weakly suppresses
- L17:2016 weakly suppresses
- L27:677 weakly excites
- L17:2197 weakly suppresses
- L19:2361 weakly suppresses
- L17:1829 weakly suppresses
- L17:984 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- alus
- both
- both
- 主场
- enos
- 先是
- 一级
- traveler
- 主义思想
- isin
Suppresses
- eload
- olate
- ustr
- …⏎⏎⏎
- enerate
- ;⏎⏎⏎
- öt
- otomy
- emerge
- eworthy