'from' after movement or transfer verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'from' when it describes moving or passing from one place or thing to another, like 'jumps from one surface' or 'transfer of control from the robot'. It goes strongly negative on 'from' in other senses, such as 'art from this artist' or 'get enough from food'. Turning it up did not give a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
dyslexia for both linguistic and nonlinguistic domains, but speech-specific adaptation deficits. Finally, mediation models in children and adults revealed that the causal pathways from basic perception and adaptation to phonological awareness through speech categorization were not significant.
-
off a ledge, for instance -- unless a human needs the robot to drive off the ledge. When those situations happen, you need to have smooth transfer of control from the robot to the appropriate human,” Woods said.⏎“The bottom line is, robots
-
han, who conducted the research while at Villanova University in Villanova, Pennsylvania.⏎Yet the fast, stealthy Bagheera has figured out how to leap from thorn to thorn to collect its meal—while avoiding the highly aggressive ants
-
the direction) of a wave (light or sound). When a light ray passes from one transparent medium to another, it changes speed and bends.⏎- Light traveling from air and going into water – half submerged straight stick or pencil into water. The
-
Do not freeze. Discard if the vaccine has been frozen.⏎A separate sterile syringe and needle must be used for each injection to prevent transmission of infectious agents from one person to another. Needles should be disposed of properly and not recapped
-
.⏎The spinal cord runs through the spinal canal, a tunnel that is formed by the holes in the center of each of the vertebrae. Nerves branch from the spinal cord, pass through openings (foraminae) between the vertebra
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: today the stars of a real life (or everyday experiences) (the things around the outside world, the history of science and technology, and the knowledge of the natural world (physics of nature, or mathematics (or mathematics of experience, or
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
finished project! I can’t wait to have her create more pieces of art from this famous artist in this book and from the other books by the authors.<|endoftext|>
-
promise of protecting bones and preventing bone diseases such as osteoporosis. Supplemental vitamin D is popular because it is difficult (if not impossible) to get enough from food. In addition, as noted by the Centers for Disease Control and Prevention (
-
del Molino as well.⏎Live the life of a professional archaeologist as you unearth artifacts, then clean and study them. You might also try rebuilding original objects from the fragments you’ve discovered. You’ll have an unparalleled chance to get close to
-
2D plans.⏎All the codes and supporting files for this course are available at - https://github.com/PacktPublishing/Create-photorealistic-house-from-scratch-to-end-in-AutoCAD⏎- Publication date:⏎- September
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:192 excites
- L5:2925 excites
- L9:1382 suppresses
- L6:2527 excites
- L4:1394 excites
- L4:1151 excites
- L2:1848 suppresses
- L5:1922 suppresses 'to' in 'X to Y' phrases
- L6:1726 suppresses
- L4:2269 suppresses
- L0:1660 weakly suppresses
- L6:2937 weakly excites 'by' after a title or author credit
- L9:723 weakly suppresses
- L9:2451 weakly excites 'for' giving a reason or cause
- L9:1340 weakly suppresses
- L8:1627 weakly suppresses
- L6:2567 weakly suppresses "by" after a passive verb
- L4:2347 weakly excites
- L4:1122 weakly excites
- L4:1126 weakly excites
- L6:1997 weakly suppresses
- L9:1465 weakly excites
- L2:1857 weakly suppresses
- L8:2842 weakly excites
Feeds later layers
- L17:1721 suppresses 'by' introducing a method or means
- L15:2443 suppresses
- L18:2916 suppresses
- L12:1137 suppresses
- L13:831 suppresses
- L14:2972 excites
- L15:1642 suppresses
- L12:2685 excites
- L13:2832 suppresses "by" after a passive verb
- L19:2273 suppresses
- L15:1386 suppresses prepositions after passive verbs
- L14:885 suppresses
- L13:2509 suppresses
- L14:709 suppresses
- L12:2888 suppresses
- L19:2620 weakly suppresses
- L11:2158 weakly suppresses
- L14:2180 weakly suppresses
- L17:2621 weakly suppresses
- L17:2145 weakly suppresses
- L17:1058 weakly suppresses
- L17:1801 weakly suppresses
- L19:1971 weakly suppresses
- L18:1235 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 僇
- poses
- .getAmount
- .getB
- AppState
- ooting
- posX
- aversable
- .addData
- arded
Suppresses
- incer
- 前辈
- coles
- ------⏎⏎
- ặt
- փ
- ми
- 缘
- entifier
- force