'well' after is or are
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the word "well" in phrases such as "is well known" or "is well within limits", where "well" follows a form of "to be". Its strongest negative cases are phrases like "quality over quantity" and "is important", which look like the opposite side of the same idiom pattern. Turning it up gave mostly off-topic text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
broken peace and prosperity. The description of the king's palace with its fine furnishings, and its wonderful court containing the orchard of everbearing trees and vines is well known and is quite remarkable. The chief employment of the
-
with the larger form, but is not so fierce, and the white and pied rats kept as pets are generally varieties of this species. The habits of rats are well known. They are nocturnal bur
-
superhuman, unearthly scope, its mighty and unconquerable rhythm and unfailing light, the light of faith in eternal victory.⏎The story of Hercules is well known. His mother was a mortal, but his father was a god, the
-
body via an endoscope. The 100 millijoules per square centimetre of infrared energy that would be needed to rupture the capsules is well within safety limits. “It’s way below that used to remove<|endoftext|>Is a
-
cells can use morphogens to grow, induce a blood supply, and metastasize.⏎Although the concept of cell organization in response to these morphogen gradients is well documented, little is known about how these subtle concentration changes get established the first place
-
receives a⏎find polish, are found in this county, and large quantities of it are quarried⏎and transported to various markets. This county is admirably well⏎watered by Otter Creek, which rises near its southern boundary, and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: a good product, and a great product. The fact that a product is always available is the same. When it comes to effectiveness, the same product is a good way to go, and the same as the value of a product. The
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
give students new experience in more realistic environment. Classes are smaller; assuring student’s best possible attention in there specialization area. It embodies the principle of “quality over quantity”.⏎These courses have smaller number of students and classes are more goal orient
-
but you can make some pretty boneheaded mistakes and still get decent results, even if your attention to detail makes darkroom perfectionists cringe. Consistency is important, but it comes naturally with experience, and in the meantime, you’ll be
-
Skin Type) have a high likelihood of developing one or more of these common precancers if they spend time in the sun and live long enough. Location makes a difference: The closer to the equator you live, the more likely you are
-
, and , they help frame the education reform debate by publicly identifying what is important for schools to teach and for students to be able to . The standards emphasize depth over breadth, building upon key concepts as students advance. The standards promote student-driven learning
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:570 excites
- L4:881 weakly excites
- L3:1439 weakly excites
- L3:759 weakly excites
- L3:718 weakly suppresses
- L4:139 weakly excites
- L3:313 weakly suppresses
- L3:2898 weakly excites
- L3:527 weakly suppresses
- L3:2577 weakly suppresses
- L1:381 weakly excites
- L0:610 weakly excites
- L2:484 weakly suppresses
- L2:850 weakly suppresses
- L2:1928 weakly excites
- L1:496 weakly suppresses
- L4:2230 weakly suppresses
- L4:1026 weakly suppresses
- L1:2661 weakly suppresses
- L4:1379 weakly excites
- L4:2028 weakly suppresses
- L4:1157 weakly suppresses
- L4:2381 weakly excites
- L3:456 weakly suppresses
Feeds later layers
- L7:2155 suppresses
- L7:2596 suppresses
- L11:585 suppresses
- L13:2907 suppresses
- L7:1118 suppresses
- L18:2995 weakly suppresses
- L8:2430 weakly suppresses
- L22:2628 weakly excites
- L6:2769 weakly suppresses
- L7:554 weakly suppresses
- L10:899 weakly suppresses
- L21:1886 weakly suppresses
- L13:1270 weakly suppresses
- L9:806 weakly excites
- L13:1133 weakly suppresses
- L7:747 weakly suppresses
- L7:1191 weakly suppresses
- L8:2278 weakly suppresses
- L21:1550 weakly excites
- L25:1257 weakly suppresses
- L9:1755 weakly suppresses
- L17:386 weakly excites
- L14:917 weakly suppresses
- L13:2778 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 琇
- getRoot
- 而且还
- (assign
- Atom
- 砜
- asInstanceOf
- [],⏎
- GetInt
- .setSelection
Suppresses
- ขาด
- IVITY
- 原则
- ab
- 流水
- reality
- lay
- abi
- deeds
- 戏