full stops ending sentences
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the full stop at the end of a sentence, especially in dense factual passages, lists or study summaries. Turning it down made the model output endless blank lines, and turning it up gave loosely related text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
well as Ataluren pontent inhibitor an summary of the Ataluren pontent inhibitor pathways/proteins that are activated in response to each type of damage. A. A double strand break DNA break (DSB) most often results in
-
for more effective interventions and better long-term outcomes for individuals with autism and their families.”⏎More details of the study are available on the CHOP Research Institute’s website.<|endoftext|>After reading this chapter you will…⏎- understand graphs as a mathematical structure.⏎
-
plant usually flowers before the leaves appear[⏎The tree responds wel to coppicing and can sprout again from the base if cut back by fire[⏎The nectar is used to make a sweet drink[⏎The
-
ATRIP complex induces the Fanconi Anemia repair and Nucleotide Excision Repair (NER) pathways, as well as the p53 signaling pathway. C. Finally, a
-
nerve and fat.|⏎|Myeloma||A type of blood cancer that hits the plasma cells of bone marrow. Myeloma cancer cells make abnormal antibodies.|⏎|Leukemia||A type of blood cancer, starts in the bone
-
be affected by number of variables defining the nature of stimulus…⏎For example an advertisement made in contrast of black and white may be eye catching and affects perceptual selection. Expectations Consumer’s expectations also affect how things are perceived by consumer. Consumers generally
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:������������������������������������������������
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
This preview has intentionally blurred sections. Sign up to view the full version.View Full Document⏎Unformatted text preview: itself, and if ( ) ( ) lim lim
-
be found along the Pacific Coast. The climate is mild and the soil is fertile and easily farmed.⏎While medieval European medicine was still mired<|endoftext|>ASIAN WILD HORSE⏎SCIENTIFIC NAME: Equus Ferus⏎HAB
-
preview shows pages 1–2. Sign up to view the full content.⏎This preview has intentionally blurred sections. Sign up to view the full version.View Full Document⏎Unformatted text preview: 60 | | | | CHAPTER 1
-
list can be expounded upon.⏎The earliest Sanskrit medical writings refer to the benefits of its fruits, seeds, oil, leaves, roots, and bark.⏎Widely used in India and other parts of Asia, Neem is found to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:736 excites
- L21:804 suppresses
- L22:506 suppresses
- L20:460 excites
- L24:11 excites
- L19:653 suppresses
- L19:1069 excites
- L19:558 suppresses
- L17:243 suppresses
- L19:469 excites
- L17:1885 suppresses
- L17:1273 excites
- L23:813 excites
- L22:165 suppresses
- L17:1794 suppresses
- L20:88 excites
- L18:2047 suppresses
- L21:660 suppresses
- L18:1639 weakly excites
- L19:2260 weakly suppresses
- L19:605 weakly excites
- L25:207 weakly suppresses
- L19:2026 weakly excites
- L16:2857 weakly excites
Feeds later layers
- L27:313 strongly excites
- L27:361 strongly excites
- L27:1658 excites
- L27:179 suppresses
- L27:13 excites
- L27:695 weakly suppresses
- L27:1819 weakly suppresses
- L27:256 weakly suppresses
- L27:433 weakly excites
- L27:1801 weakly excites
- L27:1017 weakly suppresses
- L27:143 weakly suppresses
- L27:502 weakly suppresses
- L27:1652 weakly suppresses
- L27:487 weakly suppresses
- L27:1496 weakly excites
- L27:2710 weakly suppresses
- L27:727 weakly suppresses
- L27:3052 weakly excites
- L27:445 weakly suppresses
- L27:1120 weakly suppresses
- L27:136 weakly suppresses
- L27:2432 weakly suppresses
- L27:753 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ⏎
- . ⏎
- 。 ⏎
- ⏎ ⏎
- ! ⏎
- ) ⏎
- ? ⏎
- / ⏎
- . ⏎
Suppresses
- ⏎
- ⏎ ⏎
- ⏎ ⏎
- _________________⏎⏎
- ⏎ ⏎ ⏎
- ⏎ ⏎
- �
- ⏎ ⏎ ⏎
- ⏎ ⏎
- ⏎ ⏎