opening parenthesis after a term
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on an opening bracket "(" that starts a side note, such as an abbreviation, a label or a definition placed right after a word. When it was turned down, the model started writing lists of numbered brackets like "(a) (b) (c)", but turning it up made the text drift into ordinary prose.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and the motionless move. Cochlear implants have been an unprecedented success in biomedical engineering (1) and may only be surpassed by the visual implants currently in development (2). The first tetraplegics with implants allowing them to move robotic
-
(1) is the curved bottom part of the nail. The mottled light and dark tissue (2) is the top part of the nail.⏎As you cut the nail deeper
-
be broken using mechanical force and so the microLEDs can be easily separated from the substrate and transferred to the final backplane.<|endoftext|>Understanding Figurative Language (Part 2)⏎This is the second article addressing the matter of distinguishing between literal
-
of mutations to improve their stability was carried out by Professor David Stuart and his team at Oxford University using Diamond Light Source, the UK's national<|endoftext|>Coronavirus (COVID-19) and travel: The situation around the world is changing dramatically
-
.⏎Because the University places a high value on academic honesty, penalties for mistakes and violations are severe.⏎How new technology helps detect cheating and plagiarism⏎The answer sheets (scantrons) used for most multiple choice exams are processed by a program called
-
integrated, engineering-level computer code that models the progression of severe accidents in light water reactor nuclear power plants. MELCOR is being developed at Sandia National Laboratories (
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( (
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a graph has 4 vertices and the following relations exist (1,2), (1,4) and (2,3). Then the table would look
-
. Click and begin.⏎GCF and LCM by Prime Factorization⏎A straight forward way to find the greatest common factor (GCF) and least common multiple (LCM) using prime factorization. Article includes examples
-
斯羅 (사라, Sara), 徐那(伐) (서나[벌], Seona[beol]), 徐耶(伐) (서야[벌], Seoya[beol]), 徐羅(
-
is a series of cross sections of anatomical structure. In most atlases, the three dimensions are as latero-lateral (x), dorso-ventral (y) and rostro-caudal (z). Another one is a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:682 strongly suppresses
- L18:782 strongly suppresses
- L17:470 strongly excites
- L17:1509 excites
- L18:909 excites
- L18:2017 excites
- L16:2306 suppresses
- L8:1556 suppresses
- L18:2928 suppresses
- L18:1696 suppresses
- L12:498 excites
- L18:2674 suppresses
- L18:1938 excites
- L10:3039 excites
- L18:1123 suppresses
- L18:2941 suppresses
- L13:417 excites
- L17:465 suppresses
- L17:2842 suppresses
- L17:1614 excites
- L10:2947 suppresses
- L18:2081 suppresses
- L8:173 excites
- L14:1912 suppresses document end, then unrelated text
Feeds later layers
- L25:360 strongly suppresses
- L26:13 strongly excites
- L20:521 strongly suppresses
- L26:234 strongly suppresses
- L23:224 strongly suppresses
- L27:218 strongly suppresses
- L24:146 strongly suppresses
- L21:416 strongly suppresses
- L25:300 suppresses
- L26:378 suppresses
- L25:1058 suppresses
- L25:121 suppresses
- L24:673 suppresses
- L26:1331 suppresses
- L20:264 suppresses
- L22:317 excites
- L22:488 suppresses
- L25:2362 suppresses
- L27:152 suppresses
- L26:850 suppresses
- L23:107 suppresses
- L25:178 suppresses
- L25:748 excites
- L27:334 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- !_
- ,“
- ,在
- $r
- ило
- - ⏎
- “In
- ли
- лас
- “At
Suppresses
- (
- (
- (
- (%
- ('
- (�
- (⏎
- (.
- ("
- (“