"all" after a comma in a trailing phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "all" when it follows a comma and starts a tacked-on phrase, like ", all of which" or ", all without a license". It goes quiet, or negative, on words like "everyone" and "Everything" that start a new clause. Turning it up made the model's continuations wander into unrelated, rambling text, so the steering shows no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
New Advent and get the full contents of this website as an instant download or CD-ROM. Includes the Catholic Encyclopedia, Church Fathers, Summa, Bible and more all for only $19.99...⏎A Spanish historian; born at Cu
-
Jones, a member of the Jehovah’s Witnesses, with violating its licensing ordinance by selling books, operating as a book agent, and operating as a transient dealer, all without a license. The trial court found the Witness guilty of displaying pamphlets in
-
’s University Belfast, United Kingdom. He received his B.Tech from CUSAT and his M.Tech and PhD from Indian Institute of Technology Madras, all in Computer Science. His current research interests include data analytics, natural language processing,
-
pressure to mental health disorders can affect the ability to regulate heat. They can alter the body’s ability to sweat, change how it regulates temperature or cause dehydration, all impairing people’s capacity to deal with rising temperatures and heat waves.⏎Doctors may
-
single integrated circuit that is designed to control specific hardware functions. It consists of a central processing unit (CPU), memory, input/output peripherals, and various interfaces, all integrated into a single chip. Microcontrollers are programmable, which means that developers
-
yourself - reflect on why. What is really pushing your buttons? Consider, are you trying to control a situation, a person’s views, or their behavior, all of which are not within your control? Is there a power struggle in the making
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: both the same, except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except except
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
cause you to feel anxious, stressed, worried, sad, bored, lonely or frustrated.⏎It's important to remember it is OK to feel this way and that everyone reacts differently. Remember, this situation is temporary and, for most of us,
-
balances are an integral part of mental health diagnosis and management; no matter what the psychiatric disorder. Julie Foster, a nurse practitioner in Portland, Oregon notes, "Everything a person eats affects all aspects of physical and mental health and thus a dietary and
-
treasure hunters enter into highly charged territory. We had no such<|endoftext|>Everyone stands in front of a 24 x 36 sheet of newsprint
-
This is the trick you should apply. Do you want a garden contoured hill (hill), normal (flat), terraced, or variations? But remember, everything should fit your needs.⏎Afterwards, do not forget to notice the condition and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:267 excites
- L4:262 excites
- L3:2187 suppresses
- L13:1024 suppresses
- L11:583 excites 'both' after a paired subject
- L14:2463 excites
- L16:1071 suppresses "any" in questions and negatives
- L17:2268 excites
- L14:2292 excites
- L16:1718 suppresses
- L8:126 excites
- L8:958 suppresses
- L14:164 suppresses
- L6:2112 excites
- L11:116 excites
- L10:2123 suppresses
- L15:195 excites
- L3:2034 excites
- L10:2633 suppresses
- L15:2582 suppresses
- L8:2310 suppresses
- L12:225 suppresses
- L2:1539 suppresses
- L10:281 suppresses
Feeds later layers
- L25:2055 suppresses
- L23:625 suppresses
- L19:1424 suppresses
- L27:650 suppresses
- L20:2059 suppresses
- L21:2936 suppresses
- L26:2947 suppresses
- L24:600 suppresses
- L26:846 suppresses
- L22:505 suppresses
- L21:1892 suppresses
- L19:2682 suppresses
- L19:2413 weakly suppresses
- L23:1807 weakly suppresses
- L23:893 weakly suppresses
- L27:769 weakly suppresses
- L22:477 weakly suppresses
- L19:1892 weakly suppresses
- L26:1417 weakly suppresses
- L26:93 weakly excites
- L24:401 weakly excites 'it' referring back to a noun
- L24:1080 weakly suppresses
- L27:1052 weakly excites
- L20:1774 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 某些
- 而成
- ণ
- _than
- certain
- groups
- landers
- 他们会
- licas
- ansion
Suppresses
- 都要
- 都可以
- 都在
- 都应该
- 都有
- 都
- 都需要
- 都被
- 都认为
- 均可