"any" in questions and negatives
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word "any" when it shows up in questions, negatives or "if you have any" phrases. It was strongly negative on the word "every" in a repeated company boilerplate line. Turning it up gave text that did not clearly connect to the idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
number of ways two blue triangles can⏎be fitted together?⏎Using different numbers of sticks, how many different triangles are⏎you able to make? Can you make any rules about the numbers of⏎sticks that make the most triangles?⏎Design an arrangement
-
the corresponding digit. That means the last digit of the partial product must be in the same column as the digit of the second number. No product may begin with any additional zeros. If a particular digit is zero, the product has exactly one digit
-
people may be trapped and are inaccessible to humans themselves. Lets hope nothing nefarious results from this; bugs are creepy enough as they are.⏎If you could create any type of insect robot, what would you make?<|endoftext|>- Historic Sites⏎It
-
time. This lets you build a system that fits your energy needs and your budget.⏎I am still trying to make improvements to the design. So if you have any questions, problems or suggestions please leave a comment. I would really appreciate the feedback
-
for the future.⏎How many inventions can you think of that were first made in the first decade of the first century AD? No, I can’t think of any either, and not just because it was a long time ago. There
-
any link between the use of classical psychedelics and the risk of developing mental health problems
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a new project I have been to the project, and I have a project that I have, and I have a project, and I have a project, and I have, and I have, and I have, and I have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
more about Healthwise, visit Healthwise.org.⏎© 1995-2016 Healthwise, Incorporated. Healthwise, Healthwise for every health decision, and the Healthwise logo are trademarks of Healthwise, Incorporated.
-
wise⏎To learn more visit Healthwise.org⏎© 1995-2012 Healthwise, Incorporated. Healthwise, Healthwise for every health decision, and the Healthwise logo are trademarks of Healthwise, Incorporated.⏎
-
wise⏎To learn more visit Healthwise.org⏎© 1995-2012 Healthwise, Incorporated. Healthwise, Healthwise for every health decision, and the Healthwise logo are trademarks of Healthwise, Incorporated.
-
.⏎To learn more, visit Healthwise.org⏎© 1995-2015 Healthwise, Incorporated. Healthwise, Healthwise for every health decision, and the Healthwise logo are trademarks of Healthwise, Incorporated.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:267 strongly excites
- L4:141 excites
- L8:126 excites
- L3:2187 suppresses
- L6:1502 suppresses
- L0:442 suppresses
- L4:262 weakly excites
- L14:2546 weakly suppresses
- L3:2034 weakly excites
- L7:1350 weakly suppresses
- L6:16 weakly excites
- L14:218 weakly suppresses
- L15:39 weakly suppresses
- L3:464 weakly excites
- L12:431 weakly excites
- L8:10 weakly excites
- L8:1033 weakly suppresses
- L5:2215 weakly excites
- L8:1368 weakly suppresses
- L14:427 weakly suppresses
- L4:3024 weakly suppresses
- L4:1523 weakly suppresses
- L5:2685 weakly excites
- L15:2783 weakly suppresses
Feeds later layers
- L19:1427 suppresses
- L22:260 suppresses
- L19:2522 excites
- L17:1056 excites
- L17:963 excites
- L20:240 suppresses
- L24:360 suppresses
- L18:2450 suppresses "all" after a comma in a trailing phrase
- L20:1047 excites
- L26:111 excites
- L25:464 suppresses
- L17:1454 suppresses
- L24:434 excites
- L18:1686 suppresses
- L19:626 excites
- L17:2902 suppresses
- L24:109 suppresses
- L18:1256 suppresses
- L25:335 excites
- L24:489 suppresses
- L25:390 suppresses
- L27:681 excites
- L25:377 excites
- L18:591 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- endas
- -posts
- amentals
- лучших
- ooks
- ysts
- enames
- osas
- otas
- aments
Suppresses
- ix
- except
- imaginable
- thin
- izado
- 了吧
- 脸上
- except
- leaf
- blockSize