unclear: weak, scattered activations
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron gives only weak responses to a scattered set of things, such as parts of web addresses, the word of in dictionary entries, and single letters in formulas. No single pattern stands out, and turning it up or down did not change the text in a clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Cycle and Growth by Extracellular Cues, Fall 2012. (Massachusetts Institute of Technology: MIT OpenCourseWare), http://ocw.mit.edu (Accessed). License: Creative Commons BY-NC-SA<|endoftext|>Make your
-
the file . Your output file should contain one line with one integer: the largest diameter of any shape in the painting.⏎4 9 XXXX.XXXX ..XX.X... XX.XXX..X ....X..XX⏎There are three shapes
-
how this works⏎Tip: insert a question mark by pressing your spacebar.⏎Definition of: ALLY⏎- (n.) See Alley, a marble or taw
-
can be exemplified in the ideals Jesus Christ expresses in the New Testament — the love of God and also, love of others. The list of qualities in the Spirit of God is as follows:⏎Generosity-this is the central Christian virtue, particularly
-
its correct English to Urdu translation. We encourage everyone to contribute in adding more meanings to MeaningIn Dictionary by adding English to Urdu translations, Urdu to Roman Urdu transliterations and Urdu to English Translations. This will improve our English to Urdu Dictionary,
-
blurred sections. Sign up to view the full version.View Full Document⏎Unformatted text preview: itself, and if ( ) ( ) lim lim x c x c h x L g x = = then ( ) lim x c f x exists
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: my memory of the colors of the continents and the history of the world is accurate in my thinking. The user is a person living in a time of exploration, but the world is a single culture. The user is a person who also is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
. Here you'll find most of the German developments in the war.⏎How radio direction finders work and their use by U-boats.⏎The U-boat's eye-in-the-sky for many of the
-
of the U-boat force and gives examples of unusual gunfire activities such as shore bombardments.⏎Covers the many variations in anti-aircraft experiments on the U-boats, esp. the many changes in the conning tower (Wintergarten
-
-55 Ascender – The Flawed Fighter⏎Starting in July 1956 with a sortie over Moscow and Leningrad, the U-2 carried out its most famous mission in May 1960, undertaken
-
which enables the U-boat to stay submerged while running the diesels to recharge the batteries and also to ventilate the boat. Over 214 U-boats were fitted out with the equipment in 1943-19
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:944 suppresses
- L7:2384 weakly excites
- L3:235 weakly excites
- L7:133 weakly suppresses line break inside a sentence
- L3:860 weakly suppresses
- L1:1938 weakly suppresses
- L6:856 weakly suppresses
- L7:2672 weakly excites
- L3:3060 weakly excites
- L1:2278 weakly excites
- L2:2186 weakly excites
- L2:2541 weakly excites
- L4:2233 weakly suppresses
- L7:1632 weakly excites
- L3:2968 weakly excites the '0' in 360
- L7:853 weakly suppresses
- L1:2166 weakly suppresses
- L5:3008 weakly excites
- L7:518 weakly suppresses
- L4:2035 weakly excites
- L2:306 weakly suppresses
- L4:1487 weakly excites
- L0:2927 weakly excites
- L5:1198 weakly excites
Feeds later layers
- L12:1994 weakly excites
- L26:1014 weakly suppresses
- L15:2132 weakly excites
- L11:2683 weakly excites
- L13:961 weakly excites
- L9:265 weakly excites
- L13:2046 weakly suppresses
- L9:2213 weakly excites
- L12:353 weakly excites
- L18:2748 weakly suppresses
- L22:551 weakly excites
- L9:1606 weakly suppresses
- L10:1054 weakly excites 'from' after movement or transfer verbs
- L14:1894 weakly excites
- L11:3037 weakly excites
- L18:2558 weakly suppresses
- L19:1160 weakly suppresses
- L18:1802 weakly suppresses
- L14:2639 weakly excites
- L10:688 weakly excites
- L12:2141 weakly suppresses
- L17:243 weakly suppresses
- L14:3039 weakly suppresses
- L13:2577 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ellant
- 大气
- els
- 代言人
- 受邀
- McInt
- идеальн
- aning
- erland
- allet
Suppresses
- abble
- ué
- strup
- uish
- COPY
- thur
- -copy
- mö
- ouse
- će