unclear: word before a technical term
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron tends to fire on the word right before a technical noun, such as 'the' before 'internet' or 'point', or the bracket before 'DC'. There is no clear theme, and turning it up or down did not change the text in any recognisable way.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. There are many styles of diodes. The most common ones in everyday electronics are rectifier diodes, which convert alternating current (AC) to direct current (DC).⏎Verify you are looking at a diode. Diodes
-
of Hawai'i at Mānoa and the University of Delaware shined flashes of UV light on their eyes. Photoreceptors, the light-detecting cells
-
2)^2 in such a way that its x-coordinate is increasing at a constant rate of 2 units per second. How fast is the particle's distance to the point (-2, 0) changing at the moment that the particle is at
-
their visit.⏎This crested souvenir cup was sold by Mrs Emily Yalden who owned a shop selling china and glassware at 17, The Square, Winchester between 1887 and 1914. The cup
-
keeps them busy, forming a routine and a sense of responsibility towards them.⏎The companions<|endoftext|>The Internet of Things (IoT) is about connecting any device to the internet and enabling it to transmit data in real time without human intervention. This technology
-
decade. - one of the steepest declines experienced by any bird species.⏎In 2003 the culprit was identified - an anti-inflammatory pain-killing drug diclofenac used in veterinary medicine to treat colic in cattle.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the name of a girl, so the name of the little, and the name of the girl, the name of the girl, the name of the girl, the name of the name of the girl, the name of the name of the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
(c. 65) of his only child, a daughter, Flavia Julia, to whom he accorded the title Augusta.⏎Titus, in full Titus Vespasianus Augustus, original name Titus Flavi
-
great work Tordesillas made use of all the public archives, having access to documents of every kind. It is evident in<|endoftext|>Vitamin D, sometimes called the sunshine vitamin, plays an important role in a number of your body’s basic functions
-
When your cells can’t get glucose (a kind of sugar) to burn for energy, they burn fat instead. This leaves behind acids
-
vulnerability on full display and his soldiers’ suffering moved him to tears. It wasn’t affected or a performance; it really did upset the general.⏎Then his long, tall shadow fell across the young Hoosier from northern Indiana. For Private K
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2419 suppresses
- L12:2655 excites
- L12:1471 suppresses
- L12:1581 excites
- L11:1645 suppresses
- L12:1436 excites
- L10:2264 suppresses
- L10:1297 excites
- L10:1124 suppresses
- L11:2070 excites
- L13:1911 suppresses
- L13:846 suppresses
- L13:1919 excites
- L13:2058 excites
- L13:1059 suppresses
- L1:2366 suppresses
- L11:977 excites
- L10:1822 excites
- L13:110 weakly suppresses
- L12:2892 weakly suppresses
- L12:840 weakly suppresses
- L11:374 weakly suppresses
- L11:1345 weakly excites
- L13:1323 weakly suppresses
Feeds later layers
- L19:2176 suppresses
- L18:2235 suppresses
- L17:3040 excites
- L17:2487 suppresses
- L18:529 weakly excites
- L17:1298 weakly excites
- L16:1742 weakly suppresses
- L17:2352 weakly suppresses
- L15:617 weakly excites
- L21:1994 weakly suppresses
- L22:280 weakly suppresses
- L15:2340 weakly excites
- L16:1108 weakly excites
- L20:194 weakly excites
- L15:1454 weakly excites
- L15:494 weakly excites
- L18:2718 weakly suppresses
- L15:3047 weakly suppresses preposition introducing a definition or date
- L15:1941 weakly excites
- L21:1380 weakly excites
- L16:1121 weakly suppresses
- L22:1839 weakly excites
- L18:2790 weakly suppresses
- L18:1486 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- писан
- pired
- IMPLIED
- phạt
- ồi
- signin
- WARRANT
- rien
- egin
- `,⏎
Suppresses
- NAME
- 姓名
- 切れ
- 姓
- name
- 颜色
- 名字
- aviours
- colour
- uem