the word 'well' before -known
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'well' when it is followed by 'known' or a similar phrase like 'well-known'. Turning it up made the model repeat 'well known' and 'I know' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
.⏎Is Mood Related to Vitamin D Intake?⏎The amount of research about vitamin D and its relation to mood swings and depression is growing.⏎In addition to its well-known role in calcium absorption, vitamin D activates genes that regulate the immune system and
-
into the recipient's DNA, giving the recipient the ability to make the toxin.⏎Species-to-species transmission of DNA via mobile genetic element is quite different from the well-known means by which parents pass on their genetic material to their offspring. In animals
-
(2013) in a series of decision-making simulations. All simulations involved tasks that required collaborative problem-solving. One of the authors’ studies involves the well-known Everest simulation game. Participants were randomly assigned to one of five roles in a
-
conditions.⏎Color matching chambers are employed from the producers of textile industries to test the visual appearance of the products in various light sources. The Colour Matching Cabinet is the well- known and commonly used color measurement instrument that maintains colour consistency and quality of fabrics
-
from four species of crocodile tested positive for avian influenza virus genetic material.⏎Technical Abstract: It is well established that several wild aquatic bird species serve as reservoirs for the influenza A virus
-
-independent nation. Navajos are also full-fledged American citizens as they should be since their ancestors predate those of most others in the USA.⏎As is well-known, there are Indian tribes who have special fishing rights in various parts of the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to make a positive and perhaps even a creative response to a situation that seems to require a positive, perhaps even a creative, and maybe even a creative, and maybe even a creative, and maybe even a creative, and maybe even a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
”: Bringing basic writers’ thinking to the surface. Journal of Adolescent & Adult Literacy, 53(8), 668<|endoftext|>Contemporary Chaldeans and Assyrians:⏎One Primordial Nation,
-
used in horse racing or other equetsrian sport⏎- A list of about 3,000 words defined as easy for the Dale-Chall Readability Formula⏎- Nouns are words giving names to objects and things,
-
, who were collaborating with Frederick Law Olmsted in structures for Central Park, was soon eclipsed by the South range of the museum, by J. Cleaveland Cady, a robust exercise in rusticated brownstone neo-Romanes
-
Cell Biology⏎Chlamydomonas; Dynein ATPase; Flagella; Microscopy,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:2219 strongly excites
- L15:2575 suppresses
- L20:2512 suppresses
- L20:998 excites
- L21:1453 excites
- L18:1919 excites
- L21:1910 suppresses
- L19:2216 excites
- L20:2495 excites
- L21:2861 suppresses
- L15:2374 excites
- L14:433 suppresses
- L18:1478 excites
- L18:262 excites
- L19:2926 suppresses
- L19:1043 excites
- L13:2042 excites
- L19:2583 excites
- L21:2506 suppresses
- L19:2570 excites
- L20:1549 excites
- L21:637 excites
- L17:2299 suppresses
- L16:2367 weakly suppresses
Feeds later layers
- L27:1408 strongly excites
- L23:868 excites
- L25:1065 excites
- L26:2615 excites
- L27:1387 excites
- L24:1770 excites
- L23:1138 excites
- L24:1229 excites
- L23:1412 excites
- L27:1410 excites "as well" and "as much as"
- L23:1520 excites
- L24:2655 weakly excites
- L27:2925 weakly excites
- L23:1114 weakly suppresses
- L24:692 weakly excites
- L24:1478 weakly excites
- L25:2207 weakly excites
- L26:425 weakly excites
- L23:283 weakly excites
- L27:716 weakly excites
- L27:392 weakly excites
- L27:2592 weakly suppresses
- L23:2276 weakly suppresses
- L27:977 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- known
- known
- Known
- Known
- -known
- know
- 知
- _known
- knows
- conhec
Suppresses
- ::
- apes
- iciencies
- Traits
- ]';⏎
- ::
- imately
- INLINE
- ateg
- __).