"of" after a process noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word "of" that follows a noun describing an action or process, like "leaching of", "thinning of" or "spilling of". Turning it up did not produce an obvious change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
polyethylene are unsuitable for carbonated waters because of the material's higher gas permeability, especially in regard to oxygen (See References 3).⏎Leaching of Chemicals⏎A risk exists with some plastic bottles in that chemicals used to make
-
out your daily activities. Some of the symptoms you may experience include:⏎- Sleep problems⏎- Hot flashes⏎- Vaginal dryness⏎- Thinning of hair⏎- Sleeping difficulties⏎- Bone loss⏎- Mood swings⏎Before the
-
transportation and energy formation.⏎Several human-made deliberate or accidental activities contribute to the contamination of water. Oil spills, plastic waste dumping, overfishing. Leaching of industrial chemicals, heavy metal bioaccumulation in marine wildlife.⏎Additionally,
-
breadboard used in this instructable)⏎Allows testing of electronic components without soldering⏎Two Jumper Wires⏎Connect the Arduino with
-
before being released into the environment, a person who does open burning should be fined and vehicles should use catalytic converter. Water pollution can happen with the spilling of oil in the sea, toxic substances being thrown into the river and many more.
-
spinal cord injuries or nerve damage around the bladder, which can prohibit complete emptying of the bladder⏎- Poor Hygiene Habits: use of douches and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: in the context of the population of the time, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the Pacific Ocean, this flyway encompasses the most varied waterfowl habitats in North America.⏎The westernmost flyway includes Alaska, Arizona, California, Idaho, Nevada, Oregon, Utah, and
-
fowl habitat in the U.S. portion of the Pacific Flyway alone.⏎Pacific Flyway States⏎Alaska | Arizona | California | Idaho |
-
accomplish basic tasks, it is because of a failure of nerve and guiding ideology not capacity.⏎Japan is now begging Canada for natural gas as well<|endoftext|>The Pacific Flyway stretches 4,000 miles north-to-south and 1,
-
improperly acts as one of the best breeding grounds for bacteria and foodborne viruses. Reheating rice through rice cooker or microwave
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:2454 excites
- L0:2148 weakly excites
- L0:2042 weakly suppresses
- L0:1546 weakly excites
- L1:1857 weakly suppresses
- L1:535 weakly excites
- L0:1275 weakly excites
- L1:861 weakly excites
- L1:92 weakly excites
- L0:1522 weakly suppresses
- L1:2874 weakly suppresses
- L0:1301 weakly suppresses
- L0:363 weakly suppresses
- L0:1174 weakly excites
- L1:2278 weakly excites
- L1:731 weakly suppresses
- L1:2207 weakly suppresses
- L1:1464 weakly excites
- L1:1099 weakly excites
- L1:1955 weakly suppresses
- L1:2067 weakly suppresses
- L1:445 weakly excites document start marker token
- L1:241 weakly suppresses
- L1:1391 weakly suppresses
Feeds later layers
- L4:253 excites
- L5:1210 excites
- L6:322 excites
- L4:261 excites
- L5:70 suppresses
- L7:1837 excites 'of' after a process noun
- L3:110 suppresses
- L9:413 suppresses
- L6:31 excites
- L7:1054 excites
- L5:384 excites
- L25:1465 excites
- L8:650 excites
- L10:998 excites
- L4:178 suppresses
- L4:277 suppresses
- L17:1440 excites
- L20:112 excites
- L9:765 excites
- L5:1799 excites
- L3:349 excites
- L19:596 excites
- L10:1163 excites
- L12:2287 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ugen
- annel
- inan
- 次数
- ISTRATION
- сайта
- /validation
- 方式
- segmentation
- 崽
Suppresses
- oom
- dim
- tà
- �
- brush
- colo
- -lite
- lijk
- ships
- Bs