unclear: evaluative or explanatory phrase words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words inside sentences that comment on or explain something, such as 'isn't it amazing how', 'how cool is that', 'this means that' and 'in fact'. The pattern is loose, and turning it up did not clearly change the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of goals and check them off as you complete them. This could help you be more responsible in school.⏎- Another use of cell phones – Isn't it amazing how many features there are on a cell phone? Not just for staying in touch–
-
meta directing. The halogens<|endoftext|>I didn’t know I had access to the entire back catalog of The New York Times through my library card. How cool is that!⏎New unhealthy obsession: reading the front page of the newspaper on this day in
-
pas I have seen from people’s PowerPoint presentations is the simple copy and paste job from their speech. Your speech should be on palm cards or in Presenter View (see below), not up on your presentation. The key for a successful presentation is that
-
are many reasons to switch to solar mobile power sources. The first reason is that solar energy is a renewable resource. This means that it will never run out and we can rely on it for our energy needs.
-
before cooking.⏎- Always keep an eye on what you’re grilling.⏎- Do not use spray bottles of water to control flare-ups, as this will only make the fire worse. Flare-ups are caused by too much fat and too much
-
at the very front of the vehicle, below the front grille. …⏎- Bumper End. Bumper ends are an important addition to the bumper itself. …⏎- Valance Panel. …⏎- Inner
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the idea of a single parent, a child with a name, and the concept of a parent who is not a single parent but a mother. This is a common issue. Now, I need to think about this again to make it part
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
building cells and hormones that regulate the immune system’s response to infection, such as the way it reacts by making white blood cells that fights bacterias. The secret is to choose your fats wisely and opt for unsaturated vegetable fats rather than saturated ones
-
, and was busy trying to understand the “zoo” of hadronic particles that were being discovered in the 1960’s. (Side note: Zweig pointed out today that at the time there were
-
to sort the columns together.] Use an F test (on pages A-2 and A-3 of your Class Notes book). (You are advised NOT to use the Two-sample F-test in the Analysis Toolpak. Do the problem using simple
-
0 degrees indicates that the camera angle was parallel to the local surface and negative values indicate that the surface was invisible to the camera. As a rule of thumb,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:610 excites
- L7:332 excites
- L7:503 suppresses
- L7:567 excites
- L7:301 excites
- L7:801 suppresses words after 'as though' or 'as if'
- L7:837 suppresses
- L7:2235 excites
- L7:542 excites
- L7:667 suppresses
- L7:2652 excites
- L7:620 excites
- L6:1086 excites
- L7:80 weakly suppresses
- L7:975 weakly excites
- L6:646 weakly excites
- L7:61 weakly suppresses
- L7:94 weakly excites
- L7:422 weakly excites
- L7:380 weakly suppresses
- L7:333 weakly suppresses
- L6:78 weakly suppresses
- L6:790 weakly suppresses
- L6:2534 weakly excites
Feeds later layers
- L9:375 strongly excites
- L9:690 suppresses
- L9:2788 excites
- L10:755 excites
- L13:969 suppresses
- L12:849 suppresses
- L9:2000 suppresses
- L11:1234 suppresses
- L10:605 excites
- L9:359 suppresses
- L10:1045 suppresses
- L10:555 suppresses
- L12:116 excites
- L12:1900 excites end of document boundaries
- L13:414 suppresses
- L9:2081 suppresses
- L10:1027 suppresses
- L14:2479 suppresses
- L11:480 weakly excites
- L9:490 weakly excites
- L12:1439 weakly suppresses
- L9:113 weakly suppresses
- L12:580 weakly excites
- L11:405 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ORIZED
- ogie
- oleon
- olicy
- ewire
- Musk
- oy
- iever
- olicies
- gie
Suppresses
- maal
- McCart
- heard
- —they
- ?>'
- 因为他们
- "')
- Chatt
- them
- 椽