colon introducing an explanation
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a colon ":" that comes right after a statement and introduces an explanation, a list or an example. Turning it down made the model fill its text with colons, so the neuron is tied to that punctuation mark.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the properties all the solutions a given set of equations have is more important than finding a particular solution: this leads into some of the deepest areas in all of mathematics, both conceptually
-
in the Miami area who, for whatever reason, cannot get to a⏎safe and dark observing site: check out the locations where the⏎Southern Cross Astronomical Society⏎(Phone
-
needs of each student.⏎The Referendum funds numerous resources, including technology for media center Maker Spaces, which are collaborative areas where students can create, invent and explore:<|endoftext|>Many
-
don't want to send all the coins you got from the transaction, so you also specify how much change you are sending to another address, usually controlled by yourself: "I got
-
the Land Registry proposes the Land Titles Bill by the replacement of current deeds registration system. However, such proposal has no intention to deal with the long neglected land rights: boundary extent.”⏎Hong Kong represents a unique territory where the history of land division,
-
significant effect to decrease depression score of the mental disorder patients of Banyumas public hospital. Two times cognitive therapy was more effective than once therapy. The cognitive therapy: cognitive restructuritation has a significant effect to decrease dep ression score
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:: and: 2010/11: 2010/1/1: 2020/1/1: 2020/1/1: 2020/
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
-October, Australia reported over 200,000 cases of the flu. In 2009, they had under 60,000 cases.⏎Even in the United States, where flu season starts later
-
waged war on White people, especially women.⏎- Asian-Americans are illiterate, undesirable, full of “filth and disease” and unassimilable. They were perceived as “marginal members of the human race,” were denied
-
so many people now philosophically insist that mandatory mask mandates are unconstitutional? We’ll resist answering that question as it involves a political discussion beyond the scope of this post. But we will textually discuss whether mask mandates are unconstitutional. And they’re not
-
uth” era where the opinions of experts are viewed with skepticism, where everyone’s opinions are equally valid and opposing views (and evidence) dismissed as “fake news”; and secondly, the sharing of information through the Internet and social media, personalized
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2674 strongly suppresses
- L12:2503 strongly excites
- L4:193 excites
- L3:77 excites
- L9:396 excites colon after a metadata label
- L15:2901 excites
- L13:1771 excites
- L13:2606 excites
- L5:134 suppresses
- L0:319 excites blank space after a label colon
- L2:872 suppresses
- L13:2215 excites
- L15:2620 excites
- L14:51 excites colon that introduces a statement
- L5:75 excites
- L0:1301 suppresses
- L16:149 excites
- L0:2833 suppresses
- L0:1224 suppresses
- L0:178 weakly suppresses
- L16:43 weakly suppresses
- L16:567 weakly excites
- L13:1139 weakly suppresses
- L16:95 weakly excites
Feeds later layers
- L23:236 strongly suppresses
- L26:122 strongly suppresses
- L20:1077 strongly suppresses
- L25:4 strongly excites
- L20:841 strongly suppresses
- L19:1790 excites
- L18:2254 excites colon before a subtitle
- L27:858 suppresses
- L25:745 suppresses
- L20:1313 suppresses
- L27:646 suppresses
- L25:430 suppresses
- L24:1896 suppresses
- L19:1755 excites
- L23:171 excites
- L27:1266 suppresses
- L26:582 suppresses
- L19:973 excites
- L27:753 weakly suppresses
- L21:113 weakly excites
- L22:731 weakly suppresses
- L18:1380 weakly excites
- L18:282 weakly excites
- L18:445 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- سنة
- ferences
- explos
- sWith
- ствие
- сел
- pieces
- IMM
- المصدر
- .AF
Suppresses
- :
- ’:
- :⏎⏎
- ”:
- ):
- ":
- ':
- :</
- :')
- :',