comma after an introductory phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the comma that comes after a short opening phrase, like 'Even years after the bullying has stopped,' right before the main point of the sentence is stated. It works in the other direction too: it dips on 'then' in 'if ... then' sentences. The steered outputs did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Subsequent challenge with booster dose more effective.⏎|| Subsequent administration of antibody is less effective due to immune elimination.⏎||After antigenic stimulus, negative phase may occur due to antigen combining with any pre-existing antibody in blood.⏎
-
For those who aren’t genetically susceptible, it can cause acute illness while the biotoxins are being processed in the liver and released. However, following exposure, their detoxification system can eliminate the biotoxins via the normal mechanisms and
-
addiction is and how gambling fits in.⏎It can lead to the establishment of a powerful and difficult to break state<|endoftext|>Even before the devastating Ebola epidemic in West Africa, development agencies were highlighting that health indicators in this region were lagging the rest of
-
of suicide. Even years after the bullying has stopped, researchers have found that adults who were bullied as teens have higher levels of depression and
-
helping the baby make its way into the world.⏎Probably the Biggest Advance in Prenatal Care⏎As knowledge of the mechanics of pregnancy and birth have increased, so have the processes and systems that support them during gestation. Ultrasound was probably
-
and even the humiliation he encountered when the soldiers beat him and stripped off his clothes, and hung Him on the cross for the world to see. Even Through rejection, deprivation, persecution, and many other dealings with sinful man, sin continually tempted and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is it, what is it, what is it, what is it, what is it, what is it, what is it, what is it, what is it, what is it, what is it, what is it,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
middle class, multicultural Brooklyn neighborhood in which everyone seemed to get along. If this black family being a lodestar American family didn’t signal a shift away from racism then what would?⏎Just three years later in 1989
-
people do not believe that the choices they make will substantially improve the environment, then they are less likely to participate in activities like recycling, turning off lights when leaving
-
"allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.<|endoftext|>Permanova’s knowledge centre for industrial lasers
-
contract. This can be a publicly traded stock or gold or oil or anything that is traded on the exchange. Let’s say the underlying of the contract is Microsoft then that means that our options contract represents 100 Microsoft shares.⏎There is
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:1579 suppresses
- L6:2843 suppresses
- L8:410 suppresses
- L4:1529 excites
- L4:2769 suppresses
- L11:1399 suppresses
- L6:1471 excites
- L10:404 excites
- L9:298 weakly suppresses
- L10:1002 weakly excites
- L6:1829 weakly suppresses
- L9:306 weakly excites
- L3:989 weakly suppresses
- L6:1500 weakly excites
- L6:1485 weakly excites
- L6:1953 weakly excites
- L6:482 weakly suppresses
- L7:259 weakly suppresses
- L11:1569 weakly suppresses
- L3:771 weakly suppresses
- L3:520 weakly suppresses
- L6:3067 weakly excites
- L8:1195 weakly excites
- L6:231 weakly excites
Feeds later layers
- L13:958 excites
- L14:1538 suppresses
- L16:2846 suppresses
- L19:1507 excites
- L17:1448 suppresses
- L15:1543 suppresses
- L16:1886 excites
- L13:1375 suppresses
- L17:1129 excites
- L14:1124 suppresses
- L15:2554 suppresses
- L14:484 suppresses
- L15:3012 suppresses
- L18:1500 suppresses
- L15:1513 suppresses
- L15:1458 suppresses
- L19:3020 suppresses
- L15:2938 suppresses comma after an if-clause
- L13:878 excites
- L15:1116 suppresses
- L15:641 suppresses
- L17:845 suppresses comma after an introductory phrase
- L14:2717 suppresses
- L18:1187 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 侧结构性
- sort
- 被抓
- lopen
- 砒
- prise
- ştir
- unto
- &⏎
- sort
Suppresses
- 就会
- would
- 就
- 便会
- 就會
- 就意味着
- 辄
- 就越
- 往往会
- erland