the word "be" after modals and "to"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "be" when it follows words like "must", "need to", "has been proved to" or "to". It seems to mark a spot where a verb such as "be" is about to come, and it is quieter on the passive words that come just before "be" ("seen", "shown"). Turning it up did not produce a clear theme in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Appropriate Services in Health Care have taken into account the role of linguistic and cultural communication barriers in regards to patient-provider transactions.⏎Websites should therefore be properly translated to meet the needs of the Hispanic population. We need to consider cultural
-
was found between dangerousness and withdrawal behavior mediated by negative affect, and between low ability and withdrawal behavior mediated by negative affect. The term used was not found to be associated with stigma. It is possible that previous stigma attached to the term, mental
-
maybe Dropbox has an idiomatic way of writing Python with lots of "isinstance()"s.⏎> In general, we believe that pattern matching has been proved to be a useful and expressive tool in various modern languages. In particular, many aspects of
-
Do the prep work in advance. Do as much prep work for a project as you can before you get the kids involved. Not everything on the page needs to be their work. It’s OK to help.⏎- Schedule several short sessions for one
-
are carried over to the new data directory.⏎Stop the existing MySQL instance using the data directory. This must be a clean shutdown<|endoftext|>On April 16, 1853,
-
2050 in a cost-effective way.⏎This study starts from the perspective that all gas consumption in Europe must, by 2050, be net zero carbon. This means that it
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I don't know how to make this work." The main idea is that we need to find a solution to this problem." I don't know how to find a solution. I don't know how to find a solution. I don
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
way so that revolutionary businesses can do their thing.⏎This, of course, is hardly a novel view. Throughout the history of economic thought, government has long been seen as necessary but unproductive, a spender and regulator, rather than a value creator
-
heaves debris (ejecta) outward from the point of impact. Regolith development on asteroids also follows the lunar pattern. On Mars, sand has been shown to make up a significant portion of the regolith, whereas on Saturn’s moon
-
the world. Previously thought to be low in species diversity, the Antarctic is now known to have an unexpected richness of life. In addition, molecular techniques show Antarctica to be the birthplace of many species, driven by glacial cycles over millions of
-
2017 also happens to be the target date for the first unmanned mission for NASA’s new Space Launch System
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:777 suppresses
- L6:541 suppresses
- L7:767 excites
- L5:165 suppresses
- L7:1222 excites
- L8:315 excites
- L5:1425 excites
- L3:384 suppresses
- L7:2403 suppresses
- L3:253 weakly suppresses
- L6:1103 weakly suppresses
- L6:2626 weakly suppresses
- L6:1579 weakly suppresses
- L7:2694 weakly excites
- L8:705 weakly excites
- L2:2003 weakly suppresses 'of' after abstract nouns like 'sense' or 'view'
- L5:770 weakly suppresses
- L8:403 weakly excites
- L6:992 weakly excites
- L3:1128 weakly suppresses
- L1:1184 weakly suppresses
- L7:135 weakly suppresses 'of' after 'issue' in citations
- L5:1186 weakly suppresses
- L7:1141 weakly excites
Feeds later layers
- L11:1046 excites
- L10:460 excites
- L15:487 excites
- L12:1761 excites
- L11:329 weakly suppresses number or citation fragment split
- L18:1220 weakly excites
- L11:1297 weakly excites
- L21:2837 weakly excites
- L12:570 weakly excites
- L13:920 weakly excites
- L15:1544 weakly excites
- L13:298 weakly excites
- L22:1935 weakly excites
- L17:334 weakly excites
- L18:764 weakly excites
- L10:279 weakly suppresses
- L15:1771 weakly excites
- L10:2405 weakly excites
- L16:1259 weakly suppresses
- L11:1309 weakly excites
- L14:502 weakly excites
- L17:951 weakly suppresses
- L15:126 weakly excites
- L27:174 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- обще
- annya
- YLE
- idden
- 岁以下
- oppable
- ITIZE
- nya
- gens
- egral
Suppresses
- Co
- ico
- �
- ios
- ica
- 智
- 列
- licht
- ocol
- .AddColumn