'in' after success or help verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'in' when it comes right after verbs such as 'succeed', 'assist' or 'help', as in 'succeed in doing'. It is pushed strongly negative on 'in' that links a place or container, like 'stored in files'. Turning it up made the output odd and repetitive, which does not clearly match the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
voluntary, non-dinding process in which an impartial and neutral mediator assists the parties in reaching an agreement. A mediator does not impose a solution but creates conducive environment in
-
to prevent them from effecting their object. Some delay occurred before the brigade began its march; and the Commander-in-Chief, seeing that the Russians would succeed in carrying off the guns if not at once attacked, despatched Captain Nolan,
-
write drew public attention, put him under the limelight, and made him the only loud voice that had tremendously increase his credibility. In addition, Douglass succeeds in using a chronological flow of narrative that clearly recounts his previous miserable life condition under which
-
to be well-informed citizens.<|endoftext|>"You're a strong skater, Piet, and you have a quick mind. This is why I know you'll succeed in this important task. I wouldn't ask you to do this if I didn't
-
and uncover the remarkable ways in which they assist us in diagnosing and managing our health.⏎Table of Contents⏎Cancer is a disease
-
. At the urging of fellow scientists he attempted to form an imperial academy of science, but was thwarted by political enemies of the Jesuits. He did succeed in publishing a very timely and indispensable journal concerning the latest scientific discoveries. A lunar crater
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to be able to do with a way to get the information and I need to be able to do with a way to get the information. So, I have to go to the information and I have to go to the information.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ACTS tool captures trace links automatically. The trace links are captured in an XML file.⏎Scalability, readability issues with XML file, links are stored locally in files therefore not accessible to all users.⏎The goal of my project is to aid
-
viewable from any Internet - enabled computer in the world.⏎Files are just everywhere - they are the 'building material' of the World Wide Web, storing data in the form of text and numbers, which makes it possible for us to obtain any
-
configuration sections that a developer might define. It then looks in the application configuration file. To keep the machine configuration file manageable, it is best to put these settings in the application configuration file. However, putting the settings in the machine configuration file can
-
used to downloading data from the Cloud onto mobile devices, most do not know where the data comes from. Digital information is stored in minute magnetic dots written in layers that are only a few nanometers thick that cover
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:743 weakly suppresses
- L0:114 weakly excites
- L0:1519 weakly excites
- L0:2819 weakly suppresses
- L0:310 weakly excites
- L0:3033 weakly suppresses
- L0:1154 weakly suppresses
- L0:1280 weakly excites
- L0:1137 weakly suppresses
- L0:463 weakly excites
- L0:269 weakly suppresses
- L0:652 weakly excites
- L0:754 weakly suppresses
- L0:2121 weakly suppresses
- L0:1455 weakly excites
- L0:794 weakly excites
- L0:634 weakly excites
- L0:2347 weakly suppresses
- L0:1641 weakly excites
- L0:1132 weakly excites
- L0:2415 weakly suppresses
- L0:189 weakly suppresses
- L0:2633 weakly excites
- L0:2611 weakly excites split-off 's' starting a word
Feeds later layers
- L11:1573 weakly excites
- L22:1351 weakly suppresses
- L20:2314 weakly excites
- L20:2676 weakly excites
- L18:1985 weakly excites
- L15:1727 weakly excites
- L17:1767 weakly excites
- L6:1858 weakly excites
- L8:525 weakly excites
- L17:2133 weakly suppresses
- L14:2023 weakly suppresses
- L17:2011 weakly excites
- L20:241 weakly excites
- L23:310 weakly excites
- L27:434 weakly excites
- L22:53 weakly suppresses
- L23:988 weakly excites
- L6:2626 weakly excites
- L11:334 weakly suppresses
- L4:913 weakly excites
- L19:539 weakly excites
- L19:1590 weakly excites
- L18:616 weakly excites
- L21:1502 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 企业提供
- ilate
- .HORIZONTAL
- Soph
- 说了
- Traffic
- ivities
- лом
- уть
- ions
Suppresses
- ATUS
- acas
- _ASSERT
- aser
- 芜
- das
- dbg
- vốn
- alist
- .setdefault