'and' or 'press' in how-to steps
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small word right after an instruction verb in step-by-step directions, like 'and' in 'type X and hit enter' or 'press' after a description. Turned up, the model started repeating the word 'press' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
paste it at the following path⏎Now open Run (ctrl+R) and type your command name(Here my command name is “DOSBox“) and hit enter, your application will open. Every time you can do that to open
-
a File from HydroShare⏎· Open up Internet Explorer. To do this, type in “Internet Explorer” into the bar at the bottom left of the screen and click on it. It should open up after clicking.⏎· Type HydroShare.org
-
Click Discover (located at the top of the page — you don’t have to sign in).⏎· Type Industrial Plants PA in the search box and click on the title Industrial Plants PA. You should see a page that contains an
-
:⏎Using Visual C++ 2008 IDE⏎- Create an empty project by select File >> New >> Project. Select General >> Empty Project and type in the project name.⏎- Under folder Source, right-click Select Add >>
-
hguot⏎String #1: tough⏎String #2: HGUOT⏎You may assume that the user will always type exactly 5 characters followed by a carriage return (no need to deal with errors, etc.).⏎Reading a
-
have Adobe Digital Editions installed. It is a free software. We also strongly recommend that you sign up for an AdobeID at the Adobe website. For more details please see FAQ 1&2. To view this ebook on an iPhone,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am a 27-27 with a 27-27 through a 27-27 through a 27-27. I’m a 27-27 through a 27
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
://nrich.maths.org/⏎is one of a series of problems designed to develop learners' team⏎working skills. Other tasks in the series can be found by going to⏎What are you aiming to⏎For the task:⏎The team has
-
compared with the present.⏎The mean July temperatures in Finnish Lapland have been ca.⏎I have also had restricted access to my extensive holiday wardrobe, thanks to my pesky Skyways case taking its own ill-des
-
page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.⏎As the access to this document is restricted, you may want to look for
-
the benefits of a What You See Is What You Get (WYSIWYG).⏎What if you could simply insert your equations into your document with the click of a button? Select the mathematical expressions and characters of your choice and simply click to add
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:2899 suppresses
- L17:2580 suppresses
- L21:1410 excites
- L20:592 excites
- L13:2951 suppresses
- L14:2716 excites
- L22:2979 suppresses
- L21:1532 weakly excites
- L20:1132 weakly suppresses
- L12:2559 weakly suppresses
- L6:64 weakly suppresses
- L20:1015 weakly excites
- L19:2990 weakly suppresses
- L20:2573 weakly excites
- L13:2990 weakly suppresses
- L1:92 weakly excites
- L15:1544 weakly excites
- L21:385 weakly suppresses
- L19:1614 weakly excites
- L16:181 weakly excites
- L20:2044 weakly excites
- L3:691 weakly excites
- L21:2396 weakly excites
- L9:1766 weakly excites
Feeds later layers
- L27:2069 excites
- L25:1831 excites
- L24:2360 excites
- L25:2809 excites
- L27:1954 excites
- L26:2095 excites
- L27:1367 weakly excites
- L25:1643 weakly excites
- L27:2335 weakly excites
- L27:1668 weakly excites
- L24:610 weakly excites connecting word in how-to steps
- L24:3065 weakly excites
- L24:2685 weakly suppresses
- L27:688 weakly excites
- L24:3023 weakly suppresses
- L25:811 weakly excites
- L26:1354 weakly excites
- L24:1417 weakly excites
- L27:1357 weakly excites
- L24:2522 weakly excites
- L25:2268 weakly excites
- L25:2221 weakly excites
- L26:2543 weakly suppresses
- L26:1175 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- press
- Press
- Press
- press
- PRESS
- presses
- PRESS
- _press
- pressed
- pressed
Suppresses
- scouts
- INO
- elage
- iders
- elong
- edy
- ughter
- coop
- swingers
- 蓑