comma before an added phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma that comes right before an extra phrase which adds detail, like 'important for everyone, not just for people'. Turning it down made the model repeat 'though' endlessly, which points at the words it tends to hold back.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
not smoking, eating right, exercising regularly, staying at a healthy weight, and getting the screening tests you need.⏎A heart-healthy lifestyle is important for everyone, not just for people with existing health problems. It can help you keep
-
that chocolate has many other health benefits. Eating chocolate can promote beneficial changes to your blood pressure and cholesterol levels, both of which are good for the heart. Chocolate, especially dark, also contains plentiful levels of antioxidants that neutralize damage done to cells
-
why do you think that girls choose few scientific-technical careers?⏎I think the best way to encourage more women into technical careers is to encourage all school children, girls and boys, to develop an interest in science and the way the world works
-
functioning of your heating and air conditioning units.⏎Simple solutions can help you manage the ideal indoor levels in your home. Managing humidity should be a priority for every homeowner, especially when tailoring your heating and cooling preferences to meet your personal home needs
-
first ever Gender Equality Week from September 23 to 29, 2018!⏎The theme for Gender Equality Week is Gender equality benefits everyone, inspired by the vision of a gender equal society and the benefits of advancing gender equality
-
health problems, including heart and blood vessel disease. For help with healthy eating, see these topics:⏎Improving your fitness is good for your heart and blood vessels, as well as the rest of your body. Being active helps lower your risk of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though though
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the info and together with the real-time checksum authentication which the ZFS file system performs on all drives, you will never have to be concerned about losing any information no matter what.<|endoftext|>also a strong stimulator of creativity.⏎It became clear that
-
times during his candidacy, and always put on a brave face no matter what the circumstances were, and did what was right no matter what!⏎George Washington was indispensable in launching the U.S government. Although many
-
Feelings of frustration⏎* Feelings of incompetence⏎* Feelings of loneliness⏎* Feeling of powerlessness⏎* Believing that things will turn out bad no matter what action is taken⏎* Feelings of low self-esteem⏎* Bel
-
during national elections politicians promised us lots of things for free as long as we vote them into power; we complied and in turn demanded for them to fulfil their promises no matter what. We are also given access to social security and food parcels from the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2494 strongly suppresses
- L19:2919 strongly excites
- L18:2396 suppresses
- L19:2709 excites
- L19:260 excites
- L20:302 excites
- L19:975 suppresses
- L17:2269 excites
- L19:2683 suppresses
- L20:1764 suppresses
- L14:1565 excites
- L18:1760 weakly excites
- L20:3014 weakly excites
- L17:3068 weakly excites comma after a sentence subject
- L18:1035 weakly excites
- L16:788 weakly excites
- L5:86 weakly suppresses
- L14:323 weakly excites
- L11:997 weakly excites
- L2:564 weakly excites
- L13:2903 weakly suppresses
- L18:2658 weakly suppresses
- L19:2296 weakly suppresses
- L2:160 weakly suppresses
Feeds later layers
- L25:1503 strongly suppresses
- L27:1084 suppresses
- L24:148 suppresses
- L27:789 suppresses
- L22:2020 weakly suppresses
- L25:1484 weakly excites
- L27:1285 weakly suppresses
- L27:568 weakly excites
- L26:802 weakly suppresses
- L26:1666 weakly suppresses
- L27:647 weakly suppresses
- L23:446 weakly suppresses
- L24:961 weakly suppresses
- L23:1650 weakly excites
- L22:940 weakly suppresses
- L25:1366 weakly excites
- L24:509 weakly suppresses
- L23:2501 weakly excites
- L27:760 weakly suppresses
- L24:218 weakly excites
- L25:2663 weakly suppresses
- L22:1375 weakly suppresses
- L22:422 weakly excites
- L27:987 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ion
- ilda
- нима
- 飨
- 变为
- ]]
- interface
- ndo
- ą
- 乳
Suppresses
- though
- 尽管
- 虽然
- although
- Though
- Although
- 雖然
- although
- though
- Although