"why" and "reason" before an explanation
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "why" (and similar words like "reason" or "for") when the text is about to explain a cause or motive. When it was turned up, the written text drifted into odd, unrelated topics, so the effect on the wording was not clear.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
picture?⏎These questions will take their focus to something better. Once they’ve calmed down and appear to be past the issue, ask them what happened and explain why that behavior isn’t helpful or necessary.⏎Tip 2. A simple game of
-
Eating Helps You Become Aware of Your Eating Habits and Patterns⏎When you take a minute to think about what you’re eating, how you’re eating, and why you’re eating before you actually do it, your brain becomes
-
The disorder is chronic and often lifelong. Although symptoms typically begin in adolescence, they usually do not become problematic until mid- to late adulthood. No one knows exactly why the disorder takes so long to manifest; perhaps as those with hoarding symptoms get
-
considerable recognition in the specialist, academic⏎and industrial music communities. For further information, and for more⏎detailed descriptions of the approach taken and the justifications for⏎this approach, the following documents are recommended:⏎D., Lenoir,
-
brothers. Younger readers will only understand as much about her situation as they already know. This would be a lovely story for readers who are just starting to question why terrible things happen, but still need some distance from the horrific details of war.⏎
-
authors and their mentors are responsible<|endoftext|>Young people do not grow and develop in isolation. They need to know whose they are, from whence they have come, and why they are here. Caring parents, grandparents, and older adults are in the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: You can use a binary search tree to store a collection of numbers. Is the following statement true for the binary search tree: Let S be the set of all binary search trees. The function f(S) = f(T) where T is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
touching your mouth, nose, and eyes.⏎The COVID-19 virus spreads mainly through dewdrops of saliva or discharge from the nose when the infected individual sneezes or coughs. Therefore, it is vital for you to practice respiratory manners
-
and never heal completely, and weaker scar tissue sometimes replaces muscular tissue in these cases. Obesity, lack of use, heavy lifting, chronic cough, and chronic constipation place additional pressures on the pelvic floor. Genetically weak collagen, and smoking (
-
all coronaviruses by:⏎- Cleaning your hands frequently using either soap and warm water or alcohol-based hand sanitizers,⏎- Covering your cough and sneezing into your arm to reduce
-
divide this into two doses of 500 mg each. Be sure to also drink six to eight glasses of water throughout the day, to help prevent constipation.⏎Certain groups of people are at a higher risk for calcium deficiency. These groups
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:2818 excites
- L7:1241 excites
- L8:2299 excites
- L7:823 excites
- L4:1577 excites
- L8:831 suppresses
- L3:2434 excites
- L7:2535 weakly suppresses
- L6:2099 weakly suppresses
- L5:2926 weakly excites
- L4:2898 weakly suppresses
- L6:2004 weakly excites
- L2:1689 weakly suppresses
- L6:2753 weakly suppresses
- L7:2002 weakly suppresses
- L2:1184 weakly excites
- L8:1863 weakly excites
- L7:3049 weakly suppresses
- L8:2582 weakly excites
- L7:1751 weakly suppresses
- L6:832 weakly excites
- L7:2543 weakly suppresses
- L7:1970 weakly suppresses
- L5:1345 weakly suppresses
Feeds later layers
- L10:2075 excites
- L15:2426 excites
- L18:2782 excites
- L13:1281 weakly suppresses
- L16:2565 weakly suppresses
- L17:1676 weakly suppresses
- L10:1344 weakly excites
- L11:1986 weakly excites
- L12:2880 weakly excites words that expect an of, to or for next
- L14:1814 weakly excites
- L10:2402 weakly suppresses
- L16:1676 weakly suppresses
- L26:572 weakly excites
- L27:2378 weakly excites
- L15:3006 weakly suppresses
- L10:1870 weakly suppresses
- L10:1977 weakly excites
- L21:1892 weakly suppresses
- L21:2421 weakly suppresses
- L16:932 weakly suppresses
- L16:2175 weakly excites
- L10:1821 weakly suppresses
- L21:1711 weakly excites
- L21:2275 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ONSE
- ONS
- rieve
- يان
- hev
- еб
- قيد
- 逄
- 为何
- 宸
Suppresses
- touched
- 复制
- 试试
- loid
- <Character
- 拭
- 相应的
- 尝
- Wrestling
- bart