comma opening an inserted clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a comma in a long sentence, especially the one that sets off a side remark or a new clause, such as "in certain cases, drastic changes". Its steered output did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
stripe width, color and shape, the distance between the marks and whether it has unique characteristics such as scars or, in the case of some wildebeest, broken or deformed horns.⏎Hundreds of digital images are collected in the field each
-
). In the poorly buffered forest lakes, the decrease in pH was clearly harmful. In clear-water lakes, fish fauna was subject to considerable and, in certain cases, drastic changes. It became obvious that the fish stocks would be<|endoftext|>When we judge
-
airport promised to put what had once been a minor railroad town within a day’s reach of London and Paris – and, in the minds of some Atlantans, on the same plane of international significance as those great world cities. But Eugene Black
-
electricity in schools, it is recognised that energy for other purposes such as cooking, hot water, and (in some regions) space heating, also plays an important role in improving educational quality.⏎- Education features
-
management|⏎Class 10 Science Chapter 4 Environmental management questions answers in Pdf format:⏎Here is what you all are waiting for. Teachers, parents and student, now you will find below the Solutions of Class 10 Science Chapter 4
-
technologies were using ultrasound waves or MRI for imaging.⏎However, swept source OCT follows a little bit different mechanism for the same process. Unlike sound waves or MRI techniques, OCT uses light waves for imaging. The shorter wavelength of light empowers this technology
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about the things I have been thinking about, but I have been thinking about the things I have been thinking about, but I have been thinking about, but I have been thinking about, but I have been thinking about,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
be simply due to low testosterone. Men with low testosterone may also have osteopenia or even osteoporosis (thin bones). Testosterone keeps the body skin strong , hairy and with healthy sebaceous glands. Low testosterone can result in a
-
addition to the advantages at the chip (LED) level, the nano-membranes (which are thin, at 100nm) can be broken using mechanical force and so the microLEDs can be easily separated from the substrate and
-
the Manitowoc River. Many smaller villages or encampments also could be found throughout the area. ...<|endoftext|>The words flour and flower do not only have the same root, but they were also spelled the same
-
These skills similarly translate to other areas of their lives, such as dressing ,eating, and in the academic setting.⏎3) Self Regulation– Crafts that require drying require waiting! This is a great lesson for you child to demonstrate self control and patience
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:315 excites
- L7:554 suppresses
- L10:319 suppresses
- L12:876 suppresses
- L11:558 excites
- L8:395 suppresses
- L12:25 excites unclear: mid-phrase words, mixed
- L7:1060 suppresses
- L10:936 suppresses
- L13:414 excites
- L5:769 suppresses
- L6:2011 suppresses
- L9:190 weakly excites
- L9:682 weakly suppresses
- L8:185 weakly excites
- L13:596 weakly excites
- L13:1652 weakly suppresses
- L11:1759 weakly excites
- L9:2286 weakly suppresses
- L6:109 weakly suppresses
- L5:3 weakly suppresses
- L13:2949 weakly excites
- L8:86 weakly excites
- L11:358 weakly suppresses
Feeds later layers
- L16:976 excites
- L16:2315 excites
- L17:2271 excites
- L15:852 weakly excites
- L15:2619 weakly excites
- L16:1573 weakly excites
- L15:2828 weakly excites
- L15:3048 weakly excites
- L15:2579 weakly excites
- L16:2440 weakly excites
- L16:491 weakly suppresses
- L15:1636 weakly excites
- L19:730 weakly suppresses
- L15:2298 weakly excites
- L16:2211 weakly suppresses
- L16:2393 weakly excites
- L16:1346 weakly suppresses
- L15:2552 weakly excites
- L16:433 weakly excites
- L15:1505 weakly excites
- L27:444 weakly excites
- L18:660 weakly excites
- L18:1486 weakly suppresses
- L18:2470 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- umber
- +B
- eson
- ummer
- ,b
- ..."⏎
- ainty
- らず
- "They
- yx
Suppresses
- 铟
- Filed
- ène
- cele
- cele
- .Ticks
- 直辖
- Cele
- //{⏎
- ��