the word 'how' after 'find out' or 'learn'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'how' when it follows phrases like 'find out', 'learn' or 'advice on', where a 'how to' explanation is about to begin. Turning it up did not produce any clear theme in the model's replies.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Wiki is a web-based, multi-lingual and interactive project - this means we need your input to ensure the pages are kept up to date. Find out how to contribute below.⏎Please note that this project is still being tested, if you
-
using published reference books, provides⏎rhymes, synonyms, antonyms, definitions, related words and more for⏎virtually every word. Even includes examples of how the word was used⏎in Shakespeare’s works.⏎Wordsmyth: The Educational
-
, and replaced H. cervicornis⏎as the species most often found attached or entangled on the upper branches<|endoftext|>This site is entirely user-supported. See how you can help.⏎We don't
-
available here.⏎Learn how activist judges are changing the culture of America and what We the People can do to
-
other ideas you'd like to contribute, we'd love to hear from you.⏎Find the latest in professional publications, learn new techniques and strategies, and find out how you can connect with other literacy professionals.⏎Teacher Resources by Grade⏎|1st
-
but have trouble with questions that ask them to identify the main point of a written passage. Our Veritas Prep professional instructors are able to provide students with techniques on how to improve specific skills tested in the Verbal Reasoning section.⏎Put Tips and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first time I saw the first 1551355555553555553555535555355555355553
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
implemented as the brains of the entire operation. However, the Makers realized that an RPi would be a much better suitor for the job. After all, the sophisticated cube solving algorithms required quite a bit of memory — more than the Arduino
-
have the same life cycle, nesting areas, and impact on humans.⏎The primary thing that differentiates the tropical bed bug from the common bed bug is their habitat. While the common<|endoftext|>448 pp., 6.125 x
-
is that the IC rated fixtures can be buried in insulation and the non-IC rated fixtures cannot be covered or in contact with insulation. The reason for this is because the non-IC rated fixtures do not have the temperature rating to handle the heat
-
pile. This is because it takes a very long time for the bacteria that eats dog waste (and its nutrients) to be broken down. To make things worse, you can’t just add a few drops of dog waste to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:797 excites
- L14:1128 excites
- L10:1449 suppresses
- L14:1142 excites
- L16:943 excites
- L16:1652 excites
- L14:655 excites
- L14:531 suppresses
- L14:1891 excites
- L17:1282 excites
- L15:2971 suppresses
- L16:817 weakly suppresses
- L14:3051 weakly suppresses
- L11:2954 weakly excites
- L15:1702 weakly excites
- L16:1219 weakly excites
- L8:361 weakly excites
- L17:165 weakly suppresses
- L17:2397 weakly excites
- L17:58 weakly suppresses
- L15:975 weakly suppresses
- L16:1697 weakly suppresses
- L17:689 weakly excites
- L16:1112 weakly suppresses
Feeds later layers
- L19:1881 suppresses
- L20:599 suppresses
- L20:544 suppresses
- L19:766 suppresses
- L19:958 suppresses
- L19:638 suppresses
- L19:947 excites
- L20:1112 suppresses
- L20:955 suppresses
- L19:1854 suppresses
- L20:482 suppresses
- L20:1278 weakly suppresses
- L20:708 weakly suppresses
- L19:1434 weakly suppresses
- L20:1835 weakly suppresses
- L19:270 weakly suppresses
- L20:1233 weakly suppresses
- L20:1615 weakly suppresses
- L20:884 weakly suppresses
- L22:834 weakly suppresses
- L19:1080 weakly excites
- L22:189 weakly suppresses
- L19:2372 weakly suppresses
- L19:2118 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ary
- ten
- ely
- angen
- 非常的
- even
- eri
- 但是我
- anity
- .SQL
Suppresses
- ilda
- uckle
- (Collection
- (ArrayList
- Illuminate
- each
- 淘宝
- mainland
- köp
- 階