words before 'signs' or 'symptoms'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word just before a word like 'signs', 'symptoms' or 'reasons' is likely to come next, mostly in health and advice articles. Turning it up did not produce a clear change in what the model wrote.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
paragraph, with a sentence that is split over several lines in HTML. </BODY> </HTML>When this is displayed by Mosaic, it will look like:⏎As you can probably guess, commands are enclosed in angle-brackets <>, so
-
easy noise filtering and yields excellent transient response. The components connected around the ADP1613<|endoftext|>Safed Kabbalist (1542–1620), chief disciple of Isaac Luria, the Ari, whose
-
, and the effect is just as severe in them. German Shepherds are prone to becoming obese, and in this article, you will find out the common reasons why your GSD is becoming overweight, warning signs to watch out for the tips
-
or moving around. The pain may eventually radiate to the lower right side of the abdomen, where the appendix is located.⏎Loss of Appetite⏎One sign that you may have appendicitis is a loss of appetite. This happens because the
-
of the spine)⏎- Herniated disk⏎- Viral or bacterial infection⏎What are the symptoms of torticollis?⏎The following are the most common symptoms of torticollis. However, each person may experience symptoms differently. Symptoms
-
watch for signs of wilting. Leaves that are shriveled, papery or wilted are all signs of dehydration. Likewise, mealy bugs are a sign of overwatering.⏎A moisture meter is a great tool to help you keep
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the value of the number in the form of a two-digit number in the form of a two-digit number in the form of a two-digit number. So, I think. So, I think. So, I think. So
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
says. A solar storm would still pose a risk for wandering astronauts, he adds, but there would be time to return to a shielded base.⏎To continue reading this article, subscribe to receive access to all of newscientist.com, including
-
4.COM) on the Representative List of the Intangible Cultural Heritage of Humanity⏎- Chinese paper-cut⏎Present throughout China and in various ethnic groups, paper-cut is a popular art integral
-
-clients after their HTML page has loaded ? Or what to do if we would like to selectively update only parts of a page. For example only the stock item in an HTML TABLE whose rate has changed ?⏎Let's assume that we have a Java
-
laboratory on uncommon ground.''⏎The idea for PLUG came from Singh's frustration over ''trying to conduct space-age science with stone<|endoftext|>Washington, August 7 (ANI): A team of U.S. scientists has identified phosphorylated signalling proteins in
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:310 suppresses
- L9:164 excites
- L6:295 excites
- L8:308 excites
- L10:841 suppresses
- L9:64 suppresses
- L7:305 excites
- L10:850 excites
- L11:935 excites
- L11:420 suppresses
- L11:2095 excites
- L8:323 suppresses
- L11:600 excites
- L10:448 suppresses
- L8:1000 suppresses names of agencies and institutions
- L10:483 suppresses
- L10:192 excites
- L11:598 excites
- L10:98 weakly suppresses
- L11:2135 weakly excites
- L10:2541 weakly suppresses
- L11:1905 weakly suppresses
- L11:1749 weakly excites
- L8:46 weakly suppresses
Feeds later layers
- L14:1651 strongly excites
- L15:878 suppresses
- L14:2104 suppresses
- L13:1667 excites
- L14:2639 excites
- L16:1237 excites
- L13:2144 suppresses
- L14:625 excites
- L15:741 suppresses
- L18:2589 excites
- L14:1477 suppresses
- L13:1277 suppresses
- L16:2332 excites
- L16:861 suppresses
- L13:1679 suppresses
- L15:1641 suppresses
- L13:2783 excites
- L13:1933 suppresses
- L13:1015 excites
- L18:406 suppresses
- L13:1216 suppresses
- L13:2676 excites
- L18:2947 excites
- L14:1417 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- cob
- 指定
- olon
- .Handler
- incident
- don
- events
- 常委会
- 领导干部
- besch
Suppresses
- ignment
- Replies
- yps
- Fahrenheit
- 一个问题
- eus
- iage
- 他们是
- reeNode
- ArrayType