comma before an 'especially' aside
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that comes right before a side remark like 'especially' or 'particularly'. When it was pushed down the model started repeating the word 'especially' over and over, which suggests it normally holds that word back.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
a few of the many ways to use edtech:⏎1. Conquering Teacher Shortage and Limited Course Offerings.⏎Finding qualified teachers can be a challenge, especially at this point in the year, but that doesn’t have to stop you
-
krit drama). Nandi is the name of Lord Siva’s brisha vahana (bull vehicle). Nandi bull is widely worshipped in the South, particularly in Karnataka. As a matter of fact, the sculpture of Nandi bull
-
ism. Some of the most famous ukiyo-e artists include Katsushika Hokusai,<|endoftext|>Weight loss can be a major struggle for some people, so much so that they turn to gastric bypass surgery to help them achieve their weight
-
<|endoftext|>Tips for helping children behave⏎(especially in public)⏎I thought it was time to write down some of the tips I’ve acquired that concern children and behavior, as I’ve learned what I have about the brain and how it works. What
-
have previously been reported in Europe and India and most recently in Chile. In Washington State and Oregon, Phacidiopycnis rot is common on pears, whereas speck rot is more common on apples in Washington State. Recent surveys have
-
- Check the privacy settings and think about who you really want to have access to your personal information.⏎- Be careful about what personal information you put on the internet, these details can be used by scammers to guess your passwords or to commit fraud
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially especially
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of a major collapse in agricultural production in poor countries. This will increase malnutrition already at elevated levels in these countries.⏎Sr. Bénédicte Kikwengi, SNDdeN works with her students at the high school in
-
, including the formation of placenta which develops from the same early embryo.⏎“The finding was serendipitous and at the same time a very important addition to our understanding of
-
agonists (Allbuterol/Salbutamol, Proventil, Ventolin) and theophylline (Theodur, QTSR) work by opening up the bronchial tubes. They may relieve
-
in the country just over a decade ago that has revolutionised African banking, and given access to financial services to millions of the poorest people for the first time. M-Pesa<|endoftext|>It has been said that that major historic events are often triggered by
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1598 strongly suppresses comma before a qualifying clause
- L20:1519 strongly excites
- L17:118 excites comma after a clause ending
- L19:1647 suppresses
- L16:240 weakly excites comma after 'sometimes' or 'the truth'
- L23:1648 weakly excites
- L18:623 weakly suppresses
- L14:35 weakly suppresses
- L20:2184 weakly excites
- L4:1828 weakly excites
- L12:878 weakly suppresses
- L23:720 weakly suppresses
- L16:66 weakly suppresses
- L25:116 weakly suppresses
- L5:91 weakly excites
- L24:2554 weakly excites
- L24:8 weakly suppresses
- L16:2566 weakly excites
- L16:1273 weakly suppresses
- L22:592 weakly excites
- L10:107 weakly excites unclear: spots where text was removed
- L9:2376 weakly excites
- L20:476 weakly excites commas that lead into a continuation
- L12:1657 weakly excites
Feeds later layers
- L27:2047 strongly suppresses
- L27:1498 weakly suppresses
- L27:1113 weakly excites
- L27:997 weakly suppresses
- L27:1863 weakly suppresses
- L27:1748 weakly suppresses
- L27:930 weakly excites
- L27:1554 weakly excites
- L27:2086 weakly excites
- L27:1083 weakly excites
- L27:299 weakly excites
- L27:990 weakly excites
- L27:500 weakly suppresses
- L27:1630 weakly excites
- L27:2431 weakly excites
- L27:1835 weakly excites
- L27:244 weakly suppresses
- L27:1162 weakly suppresses
- L27:1946 weakly excites the letter z inside words
- L27:226 weakly suppresses
- L27:2649 weakly excites
- L27:145 weakly excites dots inside web addresses
- L27:18 weakly excites
- L27:2611 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- _hz
- lộ
- rawl
- asmus
- 售后
- 两地
- modity
- 瀛
- пад
- 二代
Suppresses
- especially
- particularly
- particularly
- especially
- 特别是
- 尤其是
- 尤其
- 特别是在
- Especially
- 尤其是在