'yes' answering a question
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'Yes' (or the comma right after it) when it answers a yes or no question. Turning it down made the model keep repeating 'is it true' and 'the statement is true', which fits a theme about truth and yes/no answers.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
children yourself.⏎1. What is prayer? (Prayer is spiritual communication between ourselves and God.)⏎2. Can you pray when you are in trouble? (Yes.)⏎3. Can you pray when you are happy? (Yes.)⏎4.
-
(at no extra cost to you). As an Amazon Associate I earn from qualifying purchases. Please read my disclaimer for additional details.⏎Can goats eat strawberries?⏎Yes, goats can eat strawberries, however, not all goats are fond of their sour and
-
using teeth to process their meals, they also use similar movements in order to communicate with each other. How amazing is that?⏎Do Koi Lose Their Teeth?⏎Yes, koi fish may lose their teeth every once in a while. But that
-
. This search is not the biggest one, but the look of it is great.⏎But you are referring to a large diameter compared to the depth of it.⏎Yes, there is a limit. The image on the left is a diagram of an
-
rowing, canoeing and kayaking?⏎Is there, actually? Is rowing, canoeing and kayaking very different from each other? The answer is yes, they are. These are not three different techniques of operating the same boat.
-
your left pinky finger… where the nail meets the skin…” Do you think of it? Did you think of your pinky because I mentioned it? You did that because that is how quickly our brain responds.⏎Tip 1. Keep a
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: is it true? Is it not? The question is not the question of the question of the question? Is it not the question? Is it not the first of the first? I am not the first? Is it not the first?
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
bloom booster, at most, only contains only trace elements of essential micro and macronutrients.⏎Plant Magic is an example of a base nutrient plant fertiliser.⏎To be a PK booster all it has to do is is contain phosphorus and
-
``. Per urllib2, it has an ``info()`` method⏎containing things like headers, etc.⏎Upon success, if you set ``parse_xml_document=True``, this will⏎contain the parsed xml_document. I'll take care of
-
slope of the diagram.⏎A scatter diagram is composed of a horizontal axis containing the measured values of one variable and a vertical axis representing the measurements of the other variable.⏎The purpose of the scatter diagram is to display what happens to one variables when another
-
), foreign languages, health and physical education<|endoftext|>'Gay' is the word used to describe the physical and emotional attraction of a person to people of the same sex. It is often used to describe men or boys who are sexually attracted to other males
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:2721 strongly excites
- L16:1186 suppresses
- L16:1806 suppresses
- L10:263 suppresses
- L13:2939 excites
- L12:1752 excites
- L15:1667 suppresses
- L7:1670 suppresses
- L11:1592 weakly suppresses
- L15:2169 weakly suppresses
- L12:237 weakly suppresses
- L15:2385 weakly excites
- L11:1678 weakly suppresses
- L13:2761 weakly suppresses
- L7:512 weakly excites
- L3:557 weakly suppresses
- L13:438 weakly suppresses
- L10:1500 weakly suppresses
- L9:1683 weakly excites
- L16:1671 weakly excites
- L15:2412 weakly suppresses
- L16:2793 weakly suppresses
- L16:918 weakly suppresses
- L15:980 weakly excites
Feeds later layers
- L18:1784 strongly suppresses
- L23:968 strongly suppresses
- L18:1531 strongly suppresses
- L21:1538 strongly suppresses
- L21:1341 suppresses
- L25:636 suppresses
- L23:1463 suppresses
- L27:1796 suppresses
- L20:782 suppresses
- L21:1132 suppresses
- L22:2619 suppresses
- L20:1263 suppresses
- L18:2484 suppresses
- L18:1582 suppresses
- L18:2036 suppresses
- L24:1255 suppresses
- L21:1592 suppresses
- L21:2340 suppresses
- L21:1044 suppresses
- L26:1185 suppresses
- L22:1933 suppresses
- L20:1479 suppresses
- L19:2544 suppresses
- L18:1178 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- icut
- 让我们
- blurry
- 模糊
- iculo
- iele
- �示
- 大人
- ikan
- 多重
Suppresses
- True
- true
- truth
- True
- yes
- (True
- TRUE
- true
- =True
- False