unclear: asterisk symbols in mixed text
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires on a stray asterisk or star mark, especially where a new line or section begins. The examples are very mixed, so it is hard to say what the neuron is really for. Turning it up made the model ramble and sometimes repeat itself.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
is minimally. In this movement quantum of light behave as a corpuscular (no charge). b) Using its own inner impulse / intrinsic angular momentum ( h* = h / 2pi ) circle - particle rotates around its axis. In
-
and height of the previous svg, and its default value is 300*150.⏎- And this time we must define the width and height of
-
much weight,<|endoftext|>Modern China (HIST*3320)⏎Code and section: HIST*3320
-
an alpha of 10%. Show your hypotheses, calculation of F* using Excel, and either the critical F value(s) or p-value, calculated
-
goats eat strawberries”. There is much we can talk about this topic, hence, let’s spend some time reading the article and find out the fully explained answer.⏎*This post may have affiliate links, which means I may receive commissions if you choose
-
When, by chance, sodium and chlorine ions are deposited into a body of water with no outlet the positively charged sodium ions will be attracted to the negatively charged<|endoftext|>* By Steph Ellen, eHow Contributor⏎* When it is not possible to study
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:///// /u/eniationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiationiation
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
3) attending music-oriented and regular fourth grades were tested. The stimuli were two semisynthetic pseudo words /ty:ti/ and /tʉ:ti/ with the native vowel /y/ and the non-native vowel /ʉ/
-
that your search path for⏎cd starts from one of those folders.⏎For example, I spend a lot of time working in⏎/var/www. Instead of typing⏎cd /var/www/example.com all the time, I want to be able to
-
, httpd, nfsd, sshd, named, and lpd.⏎How to pronounce daemon His Dark Materials?⏎a demon (/ˈdiːmən/listen)) is a type of fictional being in Philip Pullman's fantasy trilogy
-
terminal window (Applications > Accessories > Terminal) and navigate to the newly mounted drive. All mounted drives should be in /media, so we’ll use the command⏎and then type the first few letters of our difficult-to-type drive, press tab
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2217 strongly suppresses 'trying' after 'were' or 'are'
- L18:1474 strongly suppresses
- L2:1724 suppresses
- L20:111 suppresses
- L24:593 suppresses
- L16:43 excites
- L20:190 excites
- L16:61 excites
- L25:413 suppresses
- L16:1304 excites
- L16:83 suppresses
- L18:123 suppresses
- L16:127 suppresses
- L16:96 suppresses
- L5:244 suppresses
- L16:92 excites
- L16:15 excites
- L0:1127 suppresses
- L19:193 suppresses
- L2:1436 suppresses
- L20:110 suppresses
- L17:437 weakly excites
- L21:195 weakly excites
- L22:215 weakly excites
Feeds later layers
- L27:255 strongly suppresses
- L27:2164 suppresses
- L27:327 suppresses
- L27:595 suppresses
- L27:775 weakly suppresses
- L27:1523 weakly excites
- L27:185 weakly excites
- L27:2483 weakly suppresses
- L27:2003 weakly suppresses
- L27:644 weakly suppresses
- L27:1493 weakly suppresses
- L27:580 weakly suppresses
- L27:913 weakly suppresses
- L27:2919 weakly suppresses
- L27:246 weakly suppresses
- L27:3023 weakly suppresses
- L27:1373 weakly suppresses
- L27:2182 weakly suppresses
- L27:2214 weakly suppresses
- L27:754 weakly excites
- L27:1168 weakly suppresses
- L27:2642 weakly excites
- L27:2722 weakly excites
- L27:3015 weakly suppresses 'F' starting a word in a split
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 技术和
- itle
- 院士
- alta
- 既要
- ständ
- ug
- reckon
- minister
- 不仅要
Suppresses
- /
- /O
- /OR
- /her
- /or
- /en
- /remove
- /u
- /ref
- /rem