spatial prepositions after motion verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the small word that tells where something is positioned or moving, such as 'through', 'around', 'inside', 'against' or 'with', right after a verb of insertion, wrapping or contact. Turning it up made the model write unrelated text, so the examples are the main evidence.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. This minor procedure uses a laparoscope, a viewing instrument with a light, to see your uterus and pelvis. The laparoscopy is inserted through a small incision in your belly. This procedure is generally performed under general anesthesia
-
the uterus to create a more transparent image. Hysteroscopy is another common test that involves inserting a tiny telescope through the vagina and cervix. Lastly, the doctor may choose to perform an end
-
part of getting your belly healthy again. As you can see in the image above, the TA is a thick layer of muscle. The transverse abdominal muscle wraps around the torso from front to back and the muscle fibers of the TA run horizontally,
-
is a cancer of the prostate gland. The prostate gland is a walnut-sized gland present only in men, found in the pelvis below the bladder. It wraps around the urethra (the tube that extends from the bladder) and lies in
-
-volvus – condition in which the stomach dilates with gas and/or fluid, and subsequently rotates around its short axis⏎- Heart failure⏎- Heartworm disease⏎- Heat stroke
-
A Comparison Of High-Level And Low-Level Programming Languages⏎A way to categorize programming languages is through high-level or low-level. The low-level languages communicate directly with the central processing unit or the CPU. They can perform very basic commands but are
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been going to my own home, or my own home as I live my life as I live my life as I live my life as I live my life as I live my life as I live my life as I live my life
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to go into the world and play an active role in its creation and recreation. This seems to me an endeavor fundamental to the human condition.⏎Where I diverge from Zhao and Robinson is in their discussion of creating an entrepreneurial mindset.⏎Because entrepreneurs bring
-
of antidepressant medication and psychotherapy is the best prescription.⏎One very common misconception about depression is that it feels like mere sadness. Sadness is only a part of it. It
-
The advantages and applications of this approach are manifold. Not only can it recover low-grade heat for power generation, it can also be done using thinner, lighter devices than semi-conductors. One slim cell is all that is needed to regulate the
-
that are imported from the procurement supply warehouse or purchased locally. This type of warehouse is generally close to the commodity sales market, and the scale is generally smaller than that of the procurement supply warehouse. Also engaged in the zero-removal supply
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:68 excites
- L13:2465 excites
- L15:942 suppresses
- L15:1634 excites
- L9:2806 suppresses
- L12:2833 excites
- L10:132 excites
- L11:2207 suppresses "of" after a noun in trademark and title phrases
- L8:1003 suppresses "the" or "of" before a noun phrase
- L15:1053 excites
- L15:2613 suppresses
- L15:2012 suppresses
- L6:1637 excites
- L12:850 excites
- L11:1910 excites
- L13:1054 excites
- L13:1173 excites
- L14:989 suppresses
- L15:2740 weakly suppresses
- L15:1227 weakly suppresses
- L15:2231 weakly excites
- L11:1174 weakly suppresses
- L15:894 weakly excites
- L15:1741 weakly suppresses
Feeds later layers
- L17:2267 excites
- L18:2071 weakly excites
- L17:2199 weakly excites
- L17:2753 weakly excites
- L18:1918 weakly excites
- L18:2321 weakly excites
- L20:1910 weakly excites
- L18:1143 weakly excites
- L19:241 weakly suppresses
- L18:381 weakly suppresses
- L18:1860 weakly excites
- L21:645 weakly excites
- L20:611 weakly suppresses
- L20:358 weakly suppresses
- L18:183 weakly suppresses
- L17:2281 weakly suppresses
- L17:140 weakly suppresses
- L17:182 weakly suppresses
- L20:554 weakly excites
- L21:599 weakly excites
- L19:650 weakly excites
- L21:1160 weakly excites 'is' after a subject noun about likelihood
- L22:596 weakly excites
- L18:2669 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ocoder
- тай
- (parts
- iosis
- parts
- 美德
- Parts
- 零件
- alus
- abies
Suppresses
- führer
- стр
- RIES
- 作为一个
- 学堂
- IRTUAL
- 书房
- UGH
- 通用
- 、「