unclear: pieces of split words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires weakly on the middle pieces of words and names that the model splits into fragments, such as parts of 'Kibo', 'Koss' or 'Cossack'. It is weakly negative on fragments like 'circum' and 'vigil'. Turning it up or down did not change the writing in a clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
refers to the ability of a bank or banks to meet the demands of its depositors. As the banking system is highly gicd, it does not have on hand all of the cash deposited in its system
-
peak in Africa. Mount Kilimanjaro is not just an ordinary mountain, it is the world’s largest stratovolcano with three volcanic cones: Kibo, Mawenzi and Shira. Though it appears to be dormant,
-
gap significantly.⏎Viennese researchers have developed a new route for the first truly bulk production of LLCCs, i.e. carbyne, confined inside DWCNTs. From our Raman and TEM studies with contemporary ab-initio calculations
-
was 15.2 per cent in 2006. This shows a commendable reduction of poverty. The Department of Census and Statistics (DCS) declares that the OPL is Rs. 3,7
-
well known are the Polish Cossacks (Kozacy) and the Tatar Cossacks (Nağaybäklär). The name “Cossack” should not be confused with Kazakhs (native to Kazakhstan, a
-
should be.⏎The survey was conducted during May to July 2006, and towards the end of that period France lost the World Cup final after Zinedine Zidane was sent off for headbutting an Italian player. Despite
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: , I have been thinking about lately: , I have been thinking about lately: , I have been thinking about lately: , I have been thinking about lately: , I have been thinking about lately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
collective—public—process of value creation, and enabled more value extraction. Yet these stories have become accepted as common sense—always a term to be treated circumspectly. We have become accustomed to much talk about the pros and cons of
-
).⏎Values can be taught through a dedicated curriculum. That is why my study is situated in<|endoftext|>A Cancer charity advices to watch out for symptoms.⏎Constant Vigilance for cancer recurrence has its own downsides.⏎After successful cancer treatment, being
-
exposure to death challenges the very premise of warfare.⏎The global ‘War on Terror’ has ushered in a new kind of warfare. It is no longer circumscribed in time or location, but has been extended indefinitely, operating transnationally
-
the disease: swelling of twigs and roots, yellowing of leaves and deformation of organs.⏎The fight against the “Swollen shoot” currently consists of circumscribing it, since there is to date no cure for this virus . This process
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:27 suppresses
- L2:1599 suppresses
- L3:256 suppresses
- L3:195 suppresses
- L3:28 suppresses
- L2:1816 excites
- L3:211 suppresses
- L1:119 excites
- L2:115 suppresses
- L3:786 suppresses
- L3:264 excites
- L1:1097 suppresses
- L3:1046 excites
- L0:1075 suppresses
- L2:1464 weakly suppresses
- L3:303 weakly suppresses
- L1:861 weakly excites
- L0:639 weakly suppresses
- L2:1628 weakly suppresses
- L1:678 weakly suppresses
- L1:84 weakly suppresses
- L1:1774 weakly excites
- L0:616 weakly suppresses
- L1:109 weakly excites
Feeds later layers
- L6:58 excites
- L9:708 excites
- L5:365 excites
- L9:132 suppresses
- L7:220 suppresses
- L5:230 excites
- L9:354 excites
- L15:74 suppresses
- L6:182 suppresses
- L5:14 suppresses
- L13:695 excites
- L5:315 weakly excites
- L9:437 weakly excites
- L17:798 weakly excites
- L9:324 weakly excites
- L10:1815 weakly excites
- L8:855 weakly excites
- L27:181 weakly suppresses
- L10:984 weakly suppresses
- L15:693 weakly excites commas inside numbers and asides
- L15:2065 weakly excites
- L18:2829 weakly excites
- L16:1596 weakly excites
- L12:1902 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 当地人
- ^-
- -⏎
- ornings
- ứt
- updatedAt
- WebClient
- editary
- ».
- Investments
Suppresses
- جب
- buie
- 几次
- BED
- rium
- ыв
- że
- aab
- يرة
- rise