'very' before an adjective
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'very' in phrases like 'a very small' or 'very little'. It also reacts negatively to digits buried inside numbers and reference codes. Turning it up gave some text that uses 'very cold', but also produced number loops, so the effect is only partly clear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
link="none" columns="2" size="medium" ids="2568,2567,2569,2570"]These skills enable them to increase income, in
-
speech services.⏎Other Service Providers⏎Except in the school setting, speech therapists can’t see patients without a doctor’s referral. Doctors have many patients to see and very little time. Just contacting them can cause conflict.⏎Nurses in the SNF
-
light. When the beam is disrupted, an alarm will sound. It is most effective to warn about a smoldering fire. Ionization smoke detectors contain a very small amount of americium-241 within an ionization chamber. They
-
or only negative are physically impossible, the international team came up with a way to do the next best thing. They created an effectively unipolar wave with a very sharp, high-amplitude positive peak flanked by two long, low-amplitude
-
⏎MRI scans can detect very small irregularities and produce a very high quality picture on its own, while the operator may also give the patient a
-
the porous filter material is high-temperature alumina. It does not react with molten aluminum, does not dehydrate during the roasting process, has a very small shrinkage, and has relatively stable physical and chemical properties.⏎The slurry
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what would be a perfect way to use 000000000000000000000000000000000000000
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, MA: WGBH Media Library & Archives. Retrieved from http://openvault.wgbh.org/catalog/V_4E4EE3EAD24043E2BC0B972CD24B1
-
405 Government. It means that it’s a 45 caliber bullet, pushed by 70 grains of black powder, and the bullet weighs 405 grains. Of course, things have changed, as we’ll see below
-
is still pointing to the object created in aMethod().Instance variable. i value was changed to 20 in another(),so this prints 20. Thus final answer is 10 0 20. I
-
astronomer, fellow skeptic, and fellow blogger Jeff Medkeff discovered the asteroid in 2000. It was given the preliminary designation of 2000 WG11, and Jeff had the privilege of naming it, and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:289 weakly suppresses
- L8:2103 weakly excites
- L7:734 weakly excites
- L15:1274 weakly excites
- L15:754 weakly excites
- L20:2456 weakly suppresses
- L7:1786 weakly excites
- L17:2661 weakly excites
- L15:1937 weakly suppresses
- L17:681 weakly excites
- L16:2225 weakly suppresses
- L0:648 weakly suppresses
- L6:1779 weakly suppresses
- L8:2939 weakly suppresses
- L20:733 weakly suppresses
- L2:2752 weakly excites
- L19:1586 weakly excites
- L8:961 weakly excites
- L15:2051 weakly suppresses
- L2:2450 weakly suppresses
- L13:2313 weakly excites
- L1:1905 weakly suppresses
- L18:1779 weakly excites
- L4:672 weakly suppresses
Feeds later layers
- L27:153 strongly excites the spot just before a historical number
- L25:473 strongly suppresses zeros inside large round numbers
- L27:862 suppresses
- L26:413 suppresses
- L27:396 suppresses
- L27:1153 suppresses
- L22:219 excites
- L25:1895 suppresses first digit of a year like 2020
- L22:109 weakly excites
- L22:84 weakly excites
- L22:58 weakly excites
- L22:68 weakly excites
- L24:2703 weakly suppresses
- L25:92 weakly suppresses
- L25:18 weakly suppresses
- L22:1689 weakly suppresses
- L22:20 weakly suppresses
- L23:2549 weakly suppresses
- L24:15 weakly suppresses
- L22:1187 weakly suppresses
- L26:214 weakly excites
- L22:112 weakly excites
- L26:682 weakly excites
- L27:428 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 历时
- @NoArgsConstructor
- 野
- 醪
- atrix
- reality
- urf
- خصوص
- .nextToken
- 后者
Suppresses
- 0
- ₀
- 0
- ян
- ��
- inant
- Ͳ
- boards
- aved
- imm