comma in a list or after a noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron mostly fires on commas and small joining words that come after a noun phrase, where a list or a longer description is about to continue. It has no clear topic. Turning it up made the model produce unrelated sentences about wind and streets.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Probably not. Hoarding disorder goes beyond stockpiling in an emergency. I am a psychiatrist at the University of Florida and the director of the Center for OCD, Anxiety and Related Disorders. I also recently authored a book on hoarding disorder.
-
curious readers."⏎—Andrew Piper, McGill University⏎"If there is one book to assign Humanities and Digital Humanities students that provides a wide range of knowledge about text technologies, it is this one. It introduces principal concepts along with ample historical examples, five
-
and analytical purposes. It is because the re-exported goods might require some additional information.⏎Having understood so much about reexport trade and what are re-exportation, it is<|endoftext|>10.2.2 Restarting TCP/IP⏎TCP/IP
-
. While there has been remarkable progress worldwide in giving millions of children, including girls, access to primary education, 75 million children never receive any
-
the majority of whom are either in pre-primary or primary education. With two of its programmes focusing on Life Skills and Literacy, a third on Early Childhood Development and a fourth on Nutrition, it was inevitable that the teams involved would be keen to
-
application using XCOPY will not copy the settings in the machine configuration file.⏎For more information about how the common language runtime uses the machine configuration file for assembly binding, see How the Runtime Locates Assemblies.⏎An application configuration file contains settings that
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if we have a way to show that a certain value, say, 3, is not 4? How would we do that? I can't tell you all of the details, but I can tell you that it is a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
at the moment of Austen’s birth or there about, John Adams left his farm in Massachusetts for the Continental Congress in Philadelphia. Doesn’t sound particularly interesting, I know but consider this.⏎John Adams left his home in mid-December 1
-
, B-12, and B- 6. Milk has also been shown to improve weight and bone density in children, and reduce fractures. Also research has found that pregnant women who had diets rich in milk and dairy had babies with
-
full human experience’ requires the maximization of the incorporeal spirit, with minimal focus on the physical body, though whether this remains a practically viable pursuit, I can not agree.⏎Now how does this hypothesis compare to that of Homer? Having
-
monomers can be linked together in different ways, resulting in different types of plastic. The monomers used to make PET bottles are derived from petroleum, and there have been some concerns that chemicals from the plastic could leach into the contents of the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:928 suppresses
- L20:1214 suppresses
- L20:2366 excites
- L20:80 suppresses
- L20:1595 suppresses
- L20:277 excites
- L19:1554 excites
- L19:91 excites
- L20:858 suppresses
- L20:264 excites
- L20:2998 suppresses
- L20:1003 suppresses
- L17:2277 suppresses
- L16:896 suppresses
- L8:892 suppresses
- L19:423 suppresses words that set up a following clause
- L19:2970 excites
- L19:351 excites
- L20:73 weakly suppresses
- L14:312 weakly suppresses
- L19:954 weakly suppresses
- L18:419 weakly excites
- L18:243 weakly excites
- L20:1043 weakly suppresses
Feeds later layers
- L26:194 weakly suppresses
- L22:225 weakly excites
- L22:241 weakly suppresses
- L26:87 weakly excites
- L22:61 weakly suppresses
- L27:556 weakly suppresses
- L27:326 weakly excites
- L27:1013 weakly excites
- L24:174 weakly excites
- L24:2065 weakly excites
- L27:468 weakly suppresses
- L22:2239 weakly excites
- L23:1719 weakly excites
- L23:1574 weakly excites
- L22:932 weakly excites
- L26:547 weakly excites
- L25:2059 weakly suppresses
- L23:2084 weakly excites
- L23:2591 weakly excites
- L22:727 weakly excites
- L25:1745 weakly excites
- L27:1017 weakly excites
- L23:1917 weakly excites
- L22:108 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- olesterol
- _battery
- upper
- immune
- ขน
- Compact
- serotonin
- ucle
- encryption
- vertical
Suppresses
- 对我说
- 越好
- 这样说
- 涑
- 又好
- cripts
- hof
- 也不例外
- 的例子
- 沭