unclear: word completing a verb phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The pattern here is hard to pin down. The neuron fires on words that finish a phrase after a verb, such as 'left out', 'clippings', 'color' or 'nothing', but the examples do not share a clear meaning. Turning it up gave no obvious theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
foam cools and then is heated again, after which it is left out to cure for a few hours or a few days.⏎- The foam is washed
-
lost weight overall.⏎Yoyo dieting may have more serious and long term effects on your immune system as well. Studies have shown that women with prolonged or multiple periods of weight gain and loss were less likely to produce sufficient natural killer cells, or
-
and healthy lawn without using harmful synthetic chemicals. You can make simple changes to your lawn care routine, like mowing higher (3”), leaving your grass clippings on the lawn, using organic fertilizers, aerating to reduce soil compaction
-
? what is the exta step mentioned⏎You may wish to ask the question on the associated Discussion page for that⏎article. Hopefully the author of that statement will notice it there. They are⏎almost certainly not here.⏎That said, an
-
ms.⏎Many bacterial microbes need to multiply to larger numbers in food in order to cause disease. Under warm and moist conditions, for instance, slightly contaminated food left out overnight can become highly infectious as the germs multiply. Prompt refrigeration or freezing
-
over the movement of the submarine. The result? When the audience took control, nothing happened. When they jiggled various controls and pushed various buttons…still nothing. They shouted commands and counter commands to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: [A] the number of [X] in the sequence, which is a ... ... ... ... . This is the answer for the question. The question is the ... ... ... ... . This is the answer. ... ... ... ... .
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
<|endoftext|>FROM ISSUE NUMBER 15 ~ SPRING 2013 GO TO TABLE OF CONTENTS⏎The Art of Limited Government⏎In his first inaugural address
-
over and up 256 Units (256 units right, 256 units up). Now rotate it 90 degrees. We have now created the beginning and end of the 90 degree pipe.⏎Now, lets
-
triangle. A smaller circle touches the larger circle and. . . .⏎X is a moveable point on the hypotenuse, and P and Q are the feet⏎of the perpendiculars from X to the sides of a right angled⏎triangle
-
is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:1073 suppresses
- L8:248 excites
- L7:789 suppresses
- L7:2757 suppresses
- L6:2032 excites
- L8:2307 suppresses
- L7:2091 suppresses
- L8:1551 excites
- L8:1325 excites
- L7:570 suppresses
- L8:203 excites
- L8:246 excites
- L6:195 weakly suppresses
- L7:1239 weakly suppresses
- L6:1559 weakly suppresses
- L6:1883 weakly suppresses
- L8:890 weakly suppresses
- L5:669 weakly suppresses
- L8:767 weakly excites
- L4:2374 weakly excites mixed: finance terms, strongly negative on systolic
- L7:872 weakly suppresses
- L8:141 weakly excites
- L7:2452 weakly suppresses
- L6:1930 weakly suppresses
Feeds later layers
- L14:1970 excites
- L21:2100 suppresses
- L18:1780 excites
- L12:1327 excites
- L14:1509 suppresses
- L18:2844 excites
- L15:1961 suppresses
- L13:1040 suppresses
- L21:1403 suppresses
- L13:917 weakly suppresses
- L13:626 weakly excites
- L14:937 weakly suppresses
- L10:2210 weakly suppresses
- L13:820 weakly excites comma after an introductory phrase
- L14:2771 weakly suppresses
- L15:220 weakly suppresses
- L12:2968 weakly suppresses
- L10:1930 weakly suppresses
- L13:1042 weakly excites
- L12:1207 weakly excites
- L10:2755 weakly suppresses
- L14:333 weakly suppresses
- L12:1754 weakly excites
- L18:2900 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- legen
- anguages
- imes
- rib
- 唿
- Languages
- imar
- 语言
- phia
- pons
Suppresses
- тех
- 墙上
- -final
- 结果
- 盛典
- 取得了
- getResult
- OOM
- validates
- volatile