'well' or 'get' before a verb phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on small words like 'well' or 'get' when they come right before a verb or a past participle, as in 'well known', 'get along' or 'get used to'. When it was turned up, the model kept steering toward the word 'accept' and its relatives.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
24, 2018 All News<|endoftext|>Most of the recent researches showed that diet soda is bad for organism and human metabolism, but is well known that most people actualy drink it on daily basis. Diet soda contains artificial
-
model of a successful American family. They were a black, two-professional-parent household living comfortably in a middle class, multicultural Brooklyn neighborhood in which everyone seemed to get along. If this black family being a lodestar American family didn’t signal a
-
Starting a week or two before school begins, parents can begin to wake their children up a bit earlier each day and enforce an earlier bedtime. This will help children get into a routine and adjust to the demands of the school day.⏎Another way parents
-
/RSD experienced the greatest reduction, as compared with those suffering from other chronic pain syndromes. While no adverse events were reported and the ketamine injections were well tolerated by the study participants, the study authors said that more research on complex pain
-
to limit the amount of them per day.⏎When the animals are first fed with strawberries, you should consider a small amount before leveling up so that their stomach can get used to it. Their digestive system is so sensitive that it is not able to
-
the new policies and regulations, put in place to tackle labor conditions, which also carry significant costs for garment production companies, large and small. New standards may be well intended but these costs to garment production companies also have a negative effect on Bangl
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if it is possible that the right to a full, free, and equal opportunity for both individual and collective efforts were not limited, and that the right to a full, free, and equal opportunity for both individual and collective efforts could be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, leading to laxity and wrinkling. MMP also breaks down GAGs which causes skin dehydration. Wrinkles develop as collagen fibers become disorganized and cross-linked. The number of melanocytes increases and they fail to distribute the melanin
-
unct ERIC Clearinghouse on Literacy Education)⏎Descriptors: Adult Literacy, Classroom Techniques, Curriculum Development, Daily Living Skills, Employment Potential, English (Second Language), Grammar, Health Education, Health Services, Individualized Instruction, Instructional
-
diagnosis by age 8. Individuals with autism all have difficulty with social communication and interactions, as well as restricted interests or repetitive patterns of behavior. However, the strengths and challenges for these individuals
-
itation standards help to improve patient health outcomes because accreditation creates a set of quality standards for the education of healthcare professionals and allows healthcare students to transfer credits between institutions of higher learning. Accreditation standards are also important for access to federal and state funding,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1719 suppresses
- L22:1197 weakly excites
- L20:2502 weakly excites
- L16:1747 weakly excites
- L20:2159 weakly suppresses
- L13:735 weakly suppresses
- L16:2749 weakly excites
- L3:1772 weakly excites
- L21:2236 weakly suppresses
- L16:2534 weakly suppresses
- L0:1146 weakly suppresses
- L13:960 weakly suppresses
- L5:1550 weakly suppresses
- L8:2279 weakly excites
- L11:58 weakly suppresses web address colon in urls
- L21:2319 weakly excites
- L18:2977 weakly excites
- L7:2509 weakly suppresses
- L21:1225 weakly suppresses
- L2:2649 weakly excites
- L5:2932 weakly excites
- L15:1736 weakly excites
- L11:2223 weakly suppresses
- L6:1556 weakly suppresses
Feeds later layers
- L27:2702 excites word fragments before the word ends
- L24:2299 excites
- L24:2714 excites
- L27:2622 excites
- L26:644 weakly suppresses
- L27:930 weakly excites
- L26:2670 weakly excites
- L25:567 weakly excites
- L26:367 weakly excites
- L24:1711 weakly excites
- L27:1326 weakly excites
- L25:1997 weakly excites
- L24:272 weakly suppresses
- L27:2753 weakly suppresses
- L24:1034 weakly excites
- L25:333 weakly excites
- L25:1463 weakly excites
- L24:2373 weakly suppresses
- L26:3048 weakly excites
- L25:1478 weakly suppresses
- L24:2998 weakly excites
- L26:1907 weakly excites
- L27:2127 weakly excites
- L25:1686 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 接受
- Accept
- acceptance
- accept
- accept
- accepting
- Accept
- 接受了
- accepts
- .accept
Suppresses
- etched
- ources
- ляет
- ivas
- ilig
- ount
- ika
- ainment
- RA
- Pou