blank spot before a number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the empty gap right before a number, like the space in 'bundles of ___3D' or 'in ___3 different ways'. It seems to be waiting for a digit. Turning it up or down just made the text wander into broken or repetitive wording.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Using a new printed optics technology developed by Disney Research Pittsburgh and Carnegie Mellon University, Brockmeyer and Poupyrev have designed character eyeballs made from bundles of 3D printed optical fibers.⏎This novel technology, named PAPILLON
-
cookies or want to be informed before they are stored on their computer can configure their browser for this purpose.⏎Most of today’s browsers allow the management of cookies in 3 different ways:⏎The cookies are never accepted.⏎For each cookie, the browser
-
2021 - Vaccine Types and Their Effectiveness⏎The recent approval of the commercial growing of Golden Rice (GR) based on guidelines set by a 5-interdepartmental circular is a most welcome, most awaited development.⏎Vitamin
-
Flight Test Instrumentation Technicians who all have their eyes on the same goal—safety.⏎After all, the last place you want to have any problems is 30,000 feet in the air. So each plane is thoroughly
-
is where the exchange media (tiny beads) is contained. Some water softeners come as one unit (mineral tank inside of brine tank, or as 2 separate units.⏎The brine tank should always have salt in order for a
-
century when Claude Stairs, a Belgian inventor came up with a great idea. Not many people know that lifts were invented thousands of years ago but stairs are a 13th century invention. Claude Stairs was working on the court of Count
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:Ifapersontwiththefollowingconditiondwiththefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowingconditionhavingthefollowing
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
"no" "yes"⏎ghci> map yesOrNo [True, False, True]⏎["yes", "no", "yes"]⏎Note that the arguments to⏎bool are in the opposite
-
*) memchr (str, 'p', strlen(str));⏎printf ("'p' found at position %d.\n", pch-str+1);⏎printf ("'p' not found.\n");⏎- Compare two blocks of memory (function
-
is used to count the numbers of characters in⏎a string, as well as the number of characters in the string variable⏎>>> len("a string") 8 >>> >>> s = "a long string" >>> >>>
-
<codeBase> element, which specifies where the runtime can locate an assembly (for more information, see Specifying an Assembly's Location).⏎<codeBase version="188.8.131.52" href="http
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:140 strongly suppresses
- L6:344 strongly excites
- L16:396 strongly suppresses
- L6:42 strongly suppresses
- L16:723 strongly suppresses
- L6:1550 strongly excites
- L9:974 strongly suppresses
- L5:2539 excites
- L6:917 suppresses comma after a month and day
- L4:874 suppresses opening parenthesis before acronyms
- L16:22 suppresses
- L4:1977 suppresses
- L12:2582 suppresses
- L4:2129 suppresses
- L16:1421 suppresses
- L17:15 excites
- L14:102 excites
- L14:309 excites
- L5:2991 suppresses
- L13:2204 suppresses
- L4:447 suppresses
- L4:1129 excites
- L14:51 excites colon that introduces a statement
- L9:2631 suppresses
Feeds later layers
- L24:51 strongly suppresses
- L21:29 strongly suppresses
- L26:17 strongly suppresses
- L19:509 strongly suppresses
- L21:230 strongly suppresses
- L23:262 strongly suppresses
- L24:77 strongly suppresses opening parenthesis after a name
- L20:563 strongly suppresses
- L25:222 strongly suppresses
- L26:240 strongly suppresses
- L22:14 suppresses
- L25:217 excites
- L26:21 excites
- L20:59 suppresses
- L27:68 suppresses
- L27:424 suppresses hyphen inside a compound word
- L24:141 suppresses
- L25:30 suppresses
- L27:11 excites unclear: mixed fragments in lists and pronunciations
- L25:304 suppresses
- L27:318 suppresses opening parenthesis after a name or term
- L27:33 suppresses
- L23:80 suppresses blank slot before a year or number
- L27:101 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Le
- le
- Shadow
- re
- shadow
- accord
- EN
- Re
- dot
- Fed
Suppresses
- which
- Which
- 特别是
- đ
- segue
- 尤其是
- Indeed
- 特殊的
- Maximum
- constructed