"the" after verbs like laid, reaching, raises
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on "the" right after verbs such as "laid", "reaching" or "raises", where a noun like "foundation" or "possibility" is expected next. Turned up, the model drifted into unrelated topics and did not clearly echo this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
programs (Katki et al., 2011) have informed these revised guidelines. More information on HPV and cervical cancer.⏎DCEG research provided the initial assessment of the specificity, sensitivity, and appropriate applications of the first-generation HIV
-
, and participation—cover the necessities to produce generations of environmental stewards. These objectives, coupled with the declaration’s focus on creating sustainably built environments, laid the foundation for effective environmental education that is still utilized today.⏎As environmental educators, we
-
foreign tongues. This “Pentecostal” experience allowed the apostles direct communication with God, which signaled a major shift in the religious landscape and laid the foundation for what would become Christianity. You’ll notice that the disciples are always depicted
-
established HPV as the necessary cause of this malignancy (Schiffman et al., 1993, 2007). Their efforts laid the groundwork for vaccine development and improved strategies for screening.⏎The licensure of prophyl
-
as RF, this range extends to 300 GHz.⏎RF and wireless have been around for over a century with Alexander Popov and Sir Oliver Lodge laying the groundwork for Guglielmo Marconi's wireless radio developments in the early
-
, no longer holds true. Some extremely complex and costly engineering tricks promise to help shrink the size of components etched into silicon chips further, but engineers are reaching the physical limits of how small these components, which have features measured in billionths of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: there is a new interest in the work from the people from the past. That from what I see, there is there is much in that from the people, not from the wrong, and there is so much in there. So there is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
communication between classmates before the school year starts.⏎Discover the World Through Virtual Tours⏎Thanks to technological advancements, students from kindergarten to high school can explore the world from the comfort of their own homes. Take advantage of virtual tours offered by museums, historical
-
<|endoftext|>We live in an increasingly online world. You can trade stocks, buy groceries, pay bills - almost any financial transaction you need to make can be done in the comfort of your own home, at your computer. With identity theft posing a real
-
2015, 54 of Atlanta Public Schools’ 81 schools implemented CEP<|endoftext|>I’ve been a longtime fan of Understanding Science from the University of California Museum of Paleontology at Berkeley. It’s a comprehensive resource for
-
buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:30 suppresses
- L9:24 excites "the" before a named organisation or title
- L18:799 excites
- L10:120 suppresses
- L10:1377 suppresses
- L9:662 suppresses
- L19:2283 suppresses
- L16:792 excites "the" inside a prepositional phrase
- L16:419 excites
- L18:171 excites
- L11:1168 excites
- L4:52 excites
- L4:73 suppresses
- L6:61 suppresses
- L2:205 excites
- L15:2120 suppresses
- L11:331 excites
- L13:1912 weakly excites
- L9:2198 weakly excites
- L10:1644 weakly excites
- L3:291 weakly excites
- L19:427 weakly suppresses
- L19:1023 weakly excites
- L16:1594 weakly excites
Feeds later layers
- L24:2497 excites
- L26:720 weakly suppresses 'New' in place names
- L21:172 weakly suppresses
- L23:439 weakly suppresses
- L25:381 weakly suppresses
- L21:1040 weakly suppresses
- L26:1373 weakly excites
- L26:2648 weakly excites
- L26:989 weakly suppresses
- L25:1059 weakly excites
- L27:596 weakly suppresses
- L24:590 weakly suppresses
- L25:1206 weakly suppresses
- L22:1664 weakly excites
- L24:936 weakly suppresses
- L27:2396 weakly excites
- L27:814 weakly excites
- L26:897 weakly suppresses the 'gro' fragment in words
- L21:816 weakly excites
- L26:115 weakly suppresses
- L22:878 weakly suppresses
- L21:252 weakly excites
- L23:143 weakly excites
- L23:785 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- nature
- ";}⏎
- 的
- nature
- ";}
- 的前提
- jh
- ');?>⏎
- portion
- edar
Suppresses
- 他们的
- their
- Their
- insights
- leurs
- 坏事
- 他们在
- ấy
- !",
- Their