comma after a 'before...' clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that closes an opening phrase starting with "Before" or "Prior to", such as "Before making your ornaments, discuss". It is looking for the point where the main sentence is about to start. Turning it up did not produce a clear, related change in the text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
consider the biblical story of the coming of Jesus.⏎The Star of Bethlehem⏎Read Matthew 2:1-12 with your kids.⏎Before making your ornaments, discuss:⏎- Where was Jesus born? (Matthew 2:1)⏎-
-
2 hours for seven days. The drops must be warmed to body temperature by putting the bottle in your hand for a few seconds before use. Before administering the drops, washing the affected ear(s) and drying them with a clean towel is necessary.
-
Question: How many days should Passover be observed? Please include any references to your response that is indicated in the Torah.⏎Answer: Before I answer your question, as a word of background, you need to keep in mind that Judaism, ever
-
and tribal law; other times you may be researching one or the other. This guide covers researching both areas of law.<|endoftext|>Before we may design a crystal filter it is necessary
-
the young boys are led out of seclusion and back into the community. Before festivities can begin, the head teacher (kahyuudi or kayudi) commissions a carver (
-
affected ear looks up when applying the drops. To widen the ear canal:⏎- Gently pull the earlobe back and down.⏎- Before using the ear drops, give the bottle a good shake to mix the medication.⏎- Apply the recommended number
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to do something and I have to do something, and then I am trying to do something, I am trying to write a paper, and then, I have to write a paper, and then, in this case, I have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and relative upward and downward mobility — i.e. movement up or down the socio-economic ladder. In other words, are Americans born poor becoming rich and vice-versa?⏎Interestingly enough, geographic mobility doesn’t appear have a large effect on economic mobility
-
from the Space Sciences Department at NASA’s Marshall Space Flight Center in Huntsville, Ala., will launch a weather balloon to 100,000 feet about 2 a.m. either Aug. 12 or 13
-
or architect decomposes the system requirements into functional requirements for both the software and the hardware subsystems. Traceability information lets the development team track where each requirement is addressed in the design.⏎Poor allocation decisions can result in the software being expected to perform
-
all-loving creator who meets every human need. In Psalms we read, “Give thanks to the Lord, for he is good; his love endures forever. Let the redeemed of the Lord tell their story. . . . Let them
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:2281 suppresses
- L6:2322 excites
- L10:2412 excites
- L11:2037 suppresses
- L7:2050 suppresses
- L10:463 suppresses
- L6:2303 suppresses
- L6:230 suppresses
- L5:2485 suppresses
- L7:962 excites
- L9:2052 excites 'because' and 'that' after a reason
- L4:1839 weakly suppresses
- L11:896 weakly suppresses comma closing an introductory phrase
- L10:1518 weakly excites
- L10:322 weakly excites
- L2:2160 weakly suppresses
- L6:1822 weakly suppresses
- L6:3024 weakly suppresses
- L8:170 weakly suppresses
- L8:447 weakly suppresses
- L10:3037 weakly suppresses
- L6:2754 weakly excites
- L5:2669 weakly excites
- L9:1334 weakly excites
Feeds later layers
- L14:957 excites
- L14:709 excites
- L15:2517 excites
- L15:2257 excites unclear: word stems in technical text
- L14:2512 suppresses
- L15:2338 suppresses
- L14:620 excites
- L14:576 excites
- L17:1225 suppresses
- L14:2392 suppresses
- L17:1156 excites
- L16:1984 weakly excites
- L19:544 weakly excites
- L16:1995 weakly excites
- L13:887 weakly suppresses
- L16:501 weakly suppresses
- L15:1369 weakly excites
- L25:3019 weakly excites
- L16:488 weakly excites
- L20:864 weakly excites
- L18:2296 weakly suppresses
- L20:796 weakly suppresses
- L15:456 weakly suppresses 'and' between two verbs
- L17:1076 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- *&
- icense
- 的父亲
- tle
- prise
- (pol
- )prepare
- 却被
- /close
- 負
Suppresses
- ef
- otify
- evin
- uit
- ฉบ
- 八年
- ekt
- 做人
- ore
- ในการ