prepositions in how-to location phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on small connecting words such as 'in', 'to', 'the' or 'your' in step-by-step instructions, especially where the text says where something is or where to go. Turned up, the model produced long runs of the letter C.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
files, the syntax in configuration files is case-sensitive.⏎The machine configuration file, Machine.config, contains settings that apply to an entire computer. This file is located in the %runtime
-
306 Survey Data.xlsx file from BlackBoard. Immediately save this file to your H: drive or memory stick. For purposes of this assignment consider these to be sample data
-
Files?⏎We can zip and unzip files in Windows 10 easily. To zip files:⏎Step 1: Go to File Explorer and go to the files and media you want to zip.⏎Step
-
new instance.⏎Windows MSI package installers create and set up the data directory that the installed server uses, but also create a pristine “template” data directory named⏎dataunder the installation directory. After an installation has been performed using an MSI package
-
Step⏎Finally, you have followed all the steps, you will see one shortcut on the desktop. Cut it and paste it at the following path⏎Now open Run (ctrl+R) and type your command name(Here
-
, we first have to mount it. Click on Places and then the location that you want to store the image on – in our case, a 136GB internal drive.⏎Open a terminal window (Applications >
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The question is, how much do we know about the number of human human human human human human human human human human human human human human human human human human human human human human human human human human human human human human human human human human human
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1/4 is 1/2 of 1/2<|endoftext|>Messier 52 (also known as M 52 or NGC 7654) is an open cluster in the Cassiopeia constellation.
-
the cluster, with the brightest member being magnitude 11.⏎Messier 52 is evaluated at about 35 million years old.⏎NGC 7635, also called the Bubble Nebula, Sharpless 16
-
eldovich (1967) and Field (1974) and has been clearly incorporated in the well-known book by Weinberg (1972). Some more recent books also address this analysis (Kolb and Turner
-
CE. He is also known for being the conqueror of Jerusalem.⏎What did Titus do?⏎Titus commanded a Roman legion in Judaea. In 70 CE he led a campaign that culminated in the capture and destruction of Jerusalem
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:807 excites
- L22:2104 excites
- L19:2357 suppresses
- L19:850 excites
- L22:1560 suppresses
- L4:1679 weakly excites
- L22:983 weakly excites
- L22:1065 weakly suppresses
- L2:1407 weakly suppresses
- L1:2569 weakly suppresses
- L20:2394 weakly suppresses
- L20:2585 weakly suppresses
- L9:394 weakly excites
- L0:1498 weakly excites
- L22:1928 weakly excites
- L15:889 weakly suppresses end of text after an abrupt cut
- L13:661 weakly suppresses
- L11:2684 weakly suppresses
- L18:1317 weakly suppresses
- L22:1649 weakly excites
- L22:1247 weakly excites
- L16:1446 weakly excites
- L7:2413 weakly excites
- L11:2153 weakly suppresses
Feeds later layers
- L27:629 strongly excites
- L27:495 strongly excites
- L24:658 strongly excites
- L24:485 excites
- L26:519 excites
- L26:297 excites
- L25:1154 excites
- L26:1427 excites
- L25:616 weakly excites
- L26:1055 weakly excites
- L27:552 weakly excites
- L26:539 weakly suppresses
- L26:278 weakly excites
- L25:400 weakly excites
- L27:853 weakly suppresses
- L27:817 weakly suppresses
- L24:1819 weakly suppresses
- L26:2168 weakly excites
- L24:2138 weakly suppresses comma before 'right?' tag
- L26:2339 weakly suppresses
- L24:1376 weakly excites
- L25:1344 weakly suppresses
- L24:1383 weakly suppresses
- L25:2288 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- C
- C
- _C
- ,C
- *C
- :C
- .C
- +C
- >C
- =C
Suppresses
- óż
- ialect
- 白银
- trench
- LOT
- .scss
- иона
- ancybox
- ュ
- ТЬ