comma inside big numbers
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma in large numbers like 30,000 or 3,125. When it was pushed down, the model fell into loops of code-like symbols and blank lines, and when pushed up it wandered into vague prose.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
like for example snakes as non-vision. Therefore snakes using their pit organs, which is sensitive to EM between 5000nm and 30,000nm (IR), do not "see", but somehow "feel
-
, have you ever wondered how many academic journals are there in the world? Well, I do.⏎It is estimated that there are currently more than 30,000 academic journals, and the number continues to increase by about 5
-
calculation:⏎[(4,000 lbs + 6,000 lbs) × 1.25] ÷ 4 = 3,125 lbs⏎According to this calculation, the vehicle mentioned above will require
-
that you are ready to share it. First a few important points:⏎Now you have the modification as a source file. Sending the source file will not be helpful, as probably someone else has done other modifications to the original file in the meantime.
-
ation Technicians who all have their eyes on the same goal—safety.⏎After all, the last place you want to have any problems is 30,000 feet in the air. So each plane is thoroughly tested in aspects
-
read "Philplait to Destroy the Earth!" which is awesome). If it could hit us, it would have an impact yield of at least 35,000 megatons, which
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:()){ 'lldealating manage comunicating understandating understandating understandating.'" 们的�件�件�件�件�件.) ект.) ...) ...) ...) .) ект.) .) .) .) .) .) .) .) .) .) .) .) .) .) .) .) .) .) .) .)
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.⏎Sign up today for free teaching ideas, lesson plans, online activities, tips for your classroom, and much more.⏎Choose your grade range:⏎See a sample ><|endoftext|>In any hospital, clinic
-
⏎Kode Jurnal: jpkeperawatandd100001⏎Pesan jurnal yang anda butuhkan disini…!!!<|endoftext|>from The American Heritage®
-
in establishing this method worldwide.⏎Investigated receptor is crucial for movement control<|endoftext|>255 file extension - Gimp file⏎What is 255 file? How to open
-
|ISBN: ||9781771882903 (DRM-PDF)|⏎|Read Aloud: ||not allowed|<|endoftext|>Nanoscale polymer capsules could one day be used to deliver chemotherapy direct to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1781 strongly suppresses
- L20:863 strongly excites
- L17:38 strongly suppresses
- L21:173 strongly excites
- L18:48 strongly suppresses
- L15:123 strongly suppresses
- L9:7 strongly excites
- L14:51 strongly excites colon that introduces a statement
- L16:170 suppresses
- L20:8 suppresses
- L10:33 suppresses
- L16:90 suppresses
- L21:195 excites
- L19:131 suppresses
- L19:43 excites
- L14:348 suppresses
- L2:1083 suppresses
- L12:5 excites
- L2:204 suppresses
- L1:1 excites
- L3:3 suppresses
- L0:110 excites
- L19:39 suppresses
- L6:0 excites
Feeds later layers
- L25:71 strongly suppresses
- L26:42 strongly suppresses
- L27:487 strongly excites
- L27:143 strongly suppresses
- L26:241 strongly excites
- L25:91 strongly excites
- L25:118 strongly suppresses
- L25:40 suppresses
- L26:230 excites
- L27:433 excites
- L27:1801 excites
- L23:35 suppresses
- L23:50 suppresses
- L24:130 suppresses line break at the end of a line
- L24:472 excites
- L24:938 excites
- L25:248 suppresses
- L25:1274 excites
- L25:466 excites
- L26:94 weakly suppresses
- L25:297 weakly excites
- L26:130 weakly suppresses ellipsis cut-off in quotes
- L26:729 weakly excites
- L26:319 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ⏎
- orem
- crease
- oret
- theless
- ⏎⏎
- ical
- raries
- тр
Suppresses
- ../../../
- 😉⏎⏎
- ()")⏎
- 原文地址
- 🙂⏎⏎
- =");⏎
- ())⏎
- ,…⏎⏎
- …)⏎⏎
- />⏎