word after a motion or location verb
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the small word right after an action of moving or being somewhere, such as 'hit the ground', 'gather water from the soil' or 'slip out of place'. Turning it up gave outputs that did not clearly connect to this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the top of the leaning tower of Pisa and dropped a wooden ball and a lead ball, both the same size, but different masses.⏎- They both hit the ground at the same time, even though Aristotle would say that the heavier metal ball
-
Africa. The fern is an epiphyte which means its an air plant. An air plant attaches itself to other plants, mostly trees, and gets nutrients from the air, water, and minerals that collect on the outer surface of the
-
4 feet in diameter. Inside a sponge there is a system of openings and passages called a canal system. The sponge is nourished by chemicals that they filter out of the sea water passing in and out of these canals. Mature sponges
-
grow. They are also used as a place to store food.⏎Image: amenic181/Getty Images⏎Roots grow underground and gather water and minerals from the soil. More importantly, they keep the plant from falling over. There are
-
and playing with rubber band catapult. After all, who doesn’t like to launch things across the room?!⏎Little engineers can use rubber bands to solve a STEM paintbrush engineering
-
are caused by the wear and tear of aging. The outer ring of your intervertebral disc becomes weakened over time, which allows the inner disc to slip out of place. Factors that may add to your risk for developing a herniated, rupt
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the problem is a bit with the first time, if I do this, if I keep doing this, I can see the pattern, and the first time, I have to give a few more marks, and the pattern is going to be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
_name@localhost;⏎mysql> FLUSH PRIVILEGES;⏎Step 5: Installation and Configuration of Drupal⏎Open Browser and type “”http://Server-IP/drupal”” which will open below screen to configure Drupal. Select ‘Standard
-
in the Americas but has also been seen in Africa. The resurrection fern is a non parasitic plant, however it is an epiphyte, meaning it grows on other plants but does not take nutrients from them.⏎The resurrection fern can often be
-
even been found in subtropical America and parts of southern Africa. The fern is an epiphyte which means its an air plant. An air plant attaches itself to other plants, mostly trees, and gets nutrients from the air, water, and
-
favourite amusement. There were several varieties of this diversion. Sometimes two cats were swung by their tails over a rope. Sometimes a cat was swung to the bough of a tree in a bag or sack. Sometimes it was enclosed in a leather bottle
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:999 excites
- L4:85 suppresses
- L5:158 weakly suppresses
- L10:825 weakly suppresses 'B' in vitamin B names
- L6:2461 weakly excites
- L4:21 weakly excites
- L3:1567 weakly excites
- L4:2501 weakly suppresses
- L4:19 weakly suppresses
- L6:1282 weakly suppresses
- L10:1501 weakly excites
- L5:2176 weakly excites
- L11:2525 weakly suppresses
- L13:2644 weakly suppresses
- L8:1627 weakly excites
- L10:2050 weakly excites
- L2:322 weakly suppresses
- L2:485 weakly excites
- L8:887 weakly suppresses
- L2:126 weakly excites
- L3:2605 weakly excites
- L11:1028 weakly suppresses
- L5:1094 weakly excites
- L3:2112 weakly excites
Feeds later layers
- L18:749 suppresses
- L17:1221 weakly suppresses
- L16:2624 weakly suppresses
- L26:663 weakly suppresses
- L19:2234 weakly suppresses the :// in web addresses
- L17:2333 weakly excites
- L18:1255 weakly suppresses
- L24:2747 weakly excites drug and chemical name fragments
- L19:252 weakly suppresses
- L16:1033 weakly excites
- L20:1247 weakly excites
- L26:2963 weakly suppresses
- L21:2951 weakly excites
- L24:720 weakly excites
- L17:2395 weakly excites
- L21:2407 weakly suppresses
- L16:2637 weakly excites
- L23:2446 weakly excites
- L21:2604 weakly excites
- L23:674 weakly excites
- L20:2079 weakly excites
- L16:680 weakly suppresses
- L27:853 weakly excites
- L20:1969 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- mAh
- 打开了
- ancode
- ariat
- 光阴
- 一团
- 一篇文章
- 了一场
- adden
- ordable
Suppresses
- 屿
- /server
- server
- Server
- nodes
- servers
- server
- -server
- Nodes
- (server