'less' before a comparative or negative effect
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'less' when it means something is reduced, like 'makes it less prone to drought' or 'less acidic'. When it was turned up, the model's writing drifted into loose, rambling text and did not clearly change topic.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
At 144 degrees, the proteins in eggs—which look like tightly coiled springs—begin to unfold and link together, making the dough firmer and less squishy.⏎- At 310 degrees, the so-called Ma
-
cause people to become dehydrated more easily. Some over-the-counter allergy drugs reduce sweating, an important cooling mechanism. Some mental health medications make a person feel less thirsty, meaning he or<|endoftext|>Women who had been diagnosed with breast cancer need to
-
raw milk. Proponents of raw milk argue that food in it’s most natural form is always more nutritious, and that the heating process makes pasteurized milk less nutritious. This may be true, but since Americans get a wide variety of nutrients
-
nutrient depletion and to increase organic matter, which makes it less prone to drought, flooding and water-logging. The project has helped reduce pressure
-
"aged". This means that after they are picked, the beans are dried and then kept from three to eight years. This "aging" gives the coffee a less acidic taste. Coffee that has been aged is often mixed or "blended"
-
a speculative context. One important advantage is that such a setting can help dampen emotional responses and enable a more rational discussion. The speculative context helps make the discussion less threatening to some who might react with greater hostility to discussions focused on the actual world
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a new problem that is more difficult, and I am not more confused about myself and myself in the same place of my own room, I am not more confused about myself in the same room in the same room, I am not
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
generate various water shapes. At present, there are great differences in the quality of domestically produced nozzles. Compared with similar products abroad, the biggest problem is not only the appearance but also the design quality.⏎In actual use
-
skald or scholar. The dwarves reported to the Æsir that Kvasir had choked on his own shrewdness, since there was none so wise there as to be able to question his wisdom.⏎Kvasir also
-
3, he became one of the first to author the word aight in published text. He’s even glossed it “(Alright)” for everyone who hadn’t caught on yet.⏎We learn from the OED entry that aight represents a
-
work.⏎How to Get Back in the Routine⏎So you’re sold on keeping your 8:00 p.m. standing date — but your kid, not so much. To dull resistance:⏎1. Do it<|endoftext|>Our Fifth Grade students
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2441 strongly excites
- L10:111 strongly suppresses
- L13:383 strongly suppresses
- L9:442 strongly suppresses
- L9:54 strongly excites
- L4:9 excites
- L11:1095 suppresses
- L8:1395 excites
- L12:1976 suppresses
- L7:1819 suppresses
- L11:274 suppresses
- L14:2518 excites
- L14:1859 suppresses
- L10:823 suppresses
- L7:32 excites
- L13:642 excites
- L9:1472 suppresses
- L13:2809 excites
- L8:140 excites
- L14:211 suppresses
- L6:339 excites
- L11:658 excites
- L14:1632 suppresses
- L5:6 suppresses
Feeds later layers
- L16:1221 strongly excites
- L16:1692 strongly excites
- L16:445 strongly excites
- L16:447 strongly excites
- L16:728 strongly excites
- L16:697 strongly excites
- L16:1828 strongly excites
- L16:804 strongly excites
- L16:1997 strongly excites
- L16:2763 strongly excites
- L16:2898 strongly excites
- L16:2754 strongly excites
- L16:1850 excites verbs of reducing or harming
- L16:497 excites
- L16:279 excites
- L18:1792 excites
- L19:1301 excites
- L16:2907 suppresses
- L17:443 excites
- L17:206 excites
- L16:2561 excites
- L16:295 excites
- L19:2909 excites
- L16:964 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ent
- 任何
- anymore
- 有任何
- 打扰
- ▸
- icie
- any
- entar
- ative
Suppresses
- drivers
- awah
- @s
- 新一代
- zac
- never
- ikip
- sublic
- 岁以下
- igans