weak, mixed: 'on' and 'the' after publishing verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Activations on this neuron are small and scattered. The strongest ones fall on words like 'on' after 'appeared' or 'shared', or 'is a' in a definition. It is not clear what ties them together, and turning it up gave text with no obvious link.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
market:⏎The oldest and arguably most successful cryptocurrency on the market is beyond a shadow of a doubt Bitcoin. Developed by the mysterious Satoshi Nakamoto, Bitcoin first appeared on the scene in
-
To access this title, visit your library in the app or on the desktop website.⏎Chronicles of the imagination Geographical⏎- Walta Evans "
-
locate.<|endoftext|>Science Fair Project Encyclopedia⏎The World Factbook⏎The World Factbook is an annual publication by the Central Intelligence Agency of the United States with basic almanac
-
Amazon Web Services⏎|Type of site||Web service, cloud computing|⏎Amazon Web Services (AWS) is a collection of remote computing services (also called web services) that together make up a
-
1851.⏎Please post your comment below to share with others. If you'd like to privately share a comment or correction with MMN staff, please use this form.<|endoftext|>Literally the word business means the state of being busy
-
2019 after which licensees will begin building commercial models by 2022.⏎If you liked this article, please give it a quick review on ycombinator or StumbleUpon. Thanks<|endoftext|>Potentially harmful traces of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of possible characters in the string in Python, the number of possible characters in the string in the environment of the program's code in the current environment, the number of characters in the string in the current string's string in the string
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a project for your teacher, she should have information regarding unit specifications.⏎4Select the toolbars that you will use throughout your drawing. To do this, hover your mouse over an empty space
-
and begin to code.⏎Your program should read from the file . The file will describe a single post-cubist squarist
-
5 4 3 2 1⏎We need to use the range function to iterate over the array using a for loop. The range() function returns a sequence of numbers starts from a given number to another given number with a given step
-
top-rated customer service - once you know, you Newegg.⏎If you are reading this message, Please click this link to reload this page.(Do not use your browser's "Refresh" button). Please email us if you're running the latest
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2384 excites
- L16:2136 excites
- L15:1463 excites
- L15:1456 suppresses
- L12:2117 excites
- L15:1464 suppresses
- L12:2077 excites
- L12:1904 suppresses
- L14:1508 suppresses
- L15:1914 suppresses
- L16:1259 suppresses
- L15:1397 excites
- L16:1968 excites
- L13:1515 excites "your" before doctor or health provider
- L15:1514 excites
- L16:2984 suppresses
- L16:2775 suppresses
- L9:2566 excites
- L16:958 excites
- L8:1639 suppresses
- L12:1066 excites
- L15:1434 suppresses
- L16:1436 excites
- L13:851 suppresses
Feeds later layers
- L19:1334 suppresses
- L18:2040 excites
- L19:2401 suppresses
- L18:875 suppresses
- L21:1206 suppresses
- L19:1812 suppresses
- L20:716 weakly suppresses
- L21:385 weakly suppresses
- L18:1801 weakly suppresses
- L19:552 weakly suppresses
- L19:1344 weakly suppresses
- L22:156 weakly suppresses
- L18:151 weakly excites
- L21:3028 weakly suppresses
- L19:2957 weakly suppresses
- L20:1615 weakly suppresses
- L18:781 weakly suppresses
- L18:840 weakly suppresses
- L22:827 weakly suppresses
- L24:1665 weakly suppresses
- L18:2960 weakly excites
- L21:1388 weakly suppresses
- L27:2633 weakly suppresses
- L19:2672 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- losures
- amel
- alo
- →Schema
- leys
- umo
- chein
- ements
- 〝
- alumni
Suppresses
- 霉素
- _caps
- �
- orus
- browser
- INavigation
- _oper
- naveg
- _syntax
- (sess