the zero after a decimal point
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the zero that ends a number with decimals or thousands, such as the last digit in 48,000.00 or 13.09. When it is turned down, the model tends to produce a word after a comma, but the steered writing did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
1926, A. S. Stinnett and Joe Williams paid W. A. Starnes $48,000.00 for the surface rights of Section twenty-two of Block M-2
-
leader of Easter Island, he is believed to have brought his people on 2 boats more than 1.000 (perhaps even 1.700) years ago to the island.⏎Western literature refers to Hotu Matu
-
s app, or BlueFire Reader or Txtr app. These are free, too. For more details see this article.⏎|Size: ||12.0 MB|⏎|Publisher: ||Apple Academic Press|⏎|Date published: ||
-
. What about the problems we face in adulthood? (read more here)<|endoftext|>Задание от гостя:Размещено 13.09.2016 19:19
-
1. The online catalog offers a description for each report, which can cost anywhere from $75.00 to $11,400.00.⏎According to the CDC’s website,⏎How do I know if a vaccine
-
ateral black band interrupted anteriorly on caudal peduncle (Ref. 2, 81260). Head length 33.0-38.4% of standard length; jaw teeth with slender shafts
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the role of a fast-moving small group of friends in a group setting with no extra information of the same information as two different pairs of two different groups of the same information two different pairs of two different groups of the same information two different groups
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
lot of environmental concerns – the vast amount of land required, dangers of embalming fluid, and more. Cremation isn’t too hard on the planet if enclosed incinerators
-
mounds shows no sign of erosion taking place during the construction period. There is no evidence from the region of an epic drought at this time, either."⏎Part of a much larger complex of earthen works at Poverty Point, M
-
will not veer into the political debate about global warming - its long-term impacts and solutions. Instead, we've chosen to focus on what you can do, right now, to curb the emission of greenhouse gases.⏎The Green Challenge focuses on what
-
roughly the same times every day—even if it means missing time with friends or not being able to participate in sports with later practices or games. For older teenagers,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:551 suppresses
- L10:217 excites
- L9:846 excites
- L6:101 excites
- L4:3058 excites
- L6:1801 suppresses
- L6:1135 suppresses
- L4:1008 suppresses
- L6:993 suppresses
- L7:19 suppresses
- L10:182 suppresses
- L10:121 suppresses
- L9:69 suppresses
- L10:1358 suppresses line break after page boilerplate
- L6:1736 weakly suppresses
- L6:863 weakly excites
- L7:23 weakly suppresses
- L4:2564 weakly suppresses
- L7:330 weakly suppresses
- L6:2503 weakly excites
- L6:1349 weakly excites
- L6:2477 weakly excites
- L4:2291 weakly excites
- L0:2900 weakly suppresses
Feeds later layers
- L16:656 excites
- L13:1550 excites
- L13:1001 excites
- L16:662 excites
- L14:942 excites
- L23:67 excites
- L14:453 excites
- L17:1055 excites
- L13:1513 suppresses
- L19:83 excites
- L20:353 excites
- L17:354 suppresses
- L19:211 suppresses
- L15:452 excites
- L24:635 suppresses
- L16:558 excites
- L14:943 excites
- L14:177 weakly suppresses
- L16:474 weakly excites
- L15:1344 weakly suppresses
- L14:409 weakly excites
- L24:78 weakly suppresses
- L25:334 weakly excites
- L21:243 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- APPLY
- omics
- ientes
- mts
- ích
- Disallow
- ENTS
- ỷ
- ents
- iasi
Suppresses
- createCommand
- -ver
- 生产车间
- pleado
- 侧面
- krę
- ход
- وفق
- sides
- 隊