"what" after verbs of knowing
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on "what" after words like "know", "find out", or "shows", as in "find out what the Gospels are". It is most negative on "a" or "an" right before the word "example" or "list". Turning it down made the text loop on the word "example".
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
30 grams of protein at each meal to optimize muscle protein synthesis. Though most people eat a combination of protein-containing foods at each meal, this infographic shows what 25 grams of protein from different sources looks like.⏎Researchers in Ireland recognized
-
assistance was required several times a day. For a description of what is included in each of these activities, please see the Glossary.<|endoftext|>Mad
-
is for adults 19 years of age or older. It does not apply to pregnant or breastfeeding women, because they have different nutritional requirements. Once you know what you need the most, the next logical step is to add supplements of those vitamins
-
Write About, I’m obviously partial to a publishing platform that incorporates visual writing ideas and customized user groups.⏎3. Communicate with parents.⏎Explain to parents what a blog is and why it can be a powerful tool. Ask for their feedback
-
patristic texts?⏎1. Did Mary merit to be the Mother of God?⏎2. Find out what the apocryphal Gospels are and of what value they are.⏎
-
and on-line practice.⏎GED Math - What to Expect⏎Are you considering earning your GED? Take away some of the fear of math by knowing what to expect.⏎How to Find Common Factors⏎An Efficient Method to Find Common Factors
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: an example of a simple example of a small example of a small example of an example of an example of an example of an example of an example of an example of a simple example of a small example of a small example of an example of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
or not and take the default route. Here’s an example of⏎mwhen for Monoids:⏎-- Important numbers!⏎xs = [
-
, but all recalls are listed in FDA’s weekly Enforcement Reports. See a list of vaccines that have been recalled in the past few years. ⏎Parents ought
-
test numbers. If you⏎determine that num is not divisible by 5 and 7, then increase⏎count by one.⏎Share your code⏎Show a friend, family member, or teacher what you've done!<|endoftext|>cigarette
-
citizens, including a more democratic government with greater powers given to civilians and less power given to military officials. There are many articles contained within this document, and here are some of the main ones:⏎1) Section 1 – The people shall be
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:2498 excites
- L17:266 suppresses
- L17:2950 suppresses
- L13:2491 suppresses
- L18:2489 suppresses
- L18:1927 suppresses
- L8:1179 suppresses
- L15:695 suppresses
- L4:538 suppresses
- L17:2504 suppresses
- L9:2337 suppresses
- L10:2952 excites
- L5:798 excites
- L9:463 excites
- L15:2860 weakly excites
- L16:1118 weakly excites
- L12:2065 weakly suppresses
- L17:2548 weakly excites
- L11:1024 weakly suppresses
- L17:2316 weakly excites
- L12:1811 weakly excites
- L7:861 weakly excites 'of' after 'benefits' or 'features'
- L15:919 weakly excites
- L18:780 weakly suppresses
Feeds later layers
- L20:2654 suppresses
- L22:1309 suppresses
- L26:1091 suppresses
- L27:1444 suppresses
- L21:2023 suppresses
- L20:1413 suppresses
- L21:2259 suppresses
- L22:1151 suppresses
- L20:2433 suppresses
- L22:1729 suppresses
- L22:1593 suppresses
- L20:858 suppresses
- L25:882 suppresses
- L24:2381 suppresses
- L20:2216 suppresses
- L22:1900 suppresses
- L21:1089 suppresses
- L20:1065 suppresses
- L24:930 weakly suppresses
- L23:1468 weakly suppresses
- L26:558 weakly suppresses
- L26:3035 weakly suppresses
- L21:2372 weakly suppresses
- L21:2658 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- vature
- straints
- tright
- tera
- UIControl
- processable
- arms
- tracts
- ่า
- \Entity
Suppresses
- examples
- 例子
- example
- 的例子
- 示
- Examples
- illustration
- exemple
- illustrate
- examples