genes, genomes and exons
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to genetics vocabulary, especially words like 'exons', 'introns', 'conserved' and 'HERVs' from gene and genome science. It is turned off by words like 'animal' and 'animals'. When turned up, the model's writing moved toward talk of mRNA and proteins.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Model of probabilities (HMMgene) also can locate donor and acceptor sites.⏎- Splice variants: Alternative splicing, resulting in different combination of exons, has been found to occur⏎in the primary transcripts of at least 4
-
- Search for consensus intron/exon sequences:⏎Analysis of a large number of mRNA genes has led to the identification of highly conserved consensus sequences⏎at the 5' and 3' ends of essentially all
-
from the genome by a process known as recombinational deletion. They are thought to play a key role in evolution.⏎Human endogenous retroviruses (HERVs) are suspected of involvement in some autoimmune diseases, and cancers and in particular with
-
)⏎which is converted into mRNA by the splicing out of internal sequences called "introns". The coding sequence in the mRNA⏎is derived from internal sequences called "ex
-
with twice as much insulin or clotting factor as normal. At the very least, duplicate genes should be unnecessary and therefore vulnerable to being degraded into functionless pseudogenes as new mutations arise over time⏎An NIH-supported team offers a possible answer
-
alternative burial rituals.⏎With a team of four counselors, psychologist Noé Kasali — who heads Bethesda's counseling program<|endoftext|>Human Endogenous Retroviruses (HERVs)⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: that's not, and the direction is where the direction of the magnetic field orientation angle. The first part is about the topic's interest. The application is not about a topic where the application is about the direction of the magnetic field orientation force
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
may only apply to the chromosome 22 mutation.⏎“The authors should test the same hypothesis in other animal models of autism,” says Agustin Legido, professor of pediatrics and neuro
-
ide-binding protein, suggesting that animals under calorie restriction can establish a structurally balanced architecture of gut microbiota that may
-
from Harvard University and the Max Planck Institute of Neurobiology in Martinsried has now discovered individual neurons in the brain of zebrafish larvae that control the animals' swimming speed. Human movements are also
-
these observations have led to the evolution of the Common Disease / Rare Variant hypothesis suggesting that the majority of the "missing heritability" in common and complex phenotypes is instead due to an individual's personal profile of rare or private DNA variants6
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1224 suppresses
- L0:1301 weakly suppresses
- L2:72 weakly suppresses
- L2:36 weakly excites
- L1:1464 weakly excites
- L0:178 weakly suppresses
- L2:2328 weakly suppresses
- L2:1899 weakly excites
- L2:111 weakly suppresses
- L2:1657 weakly excites
- L0:1823 weakly suppresses
- L1:439 weakly excites
- L2:570 weakly suppresses
- L2:94 weakly suppresses
- L1:162 weakly excites
- L2:246 weakly excites
- L1:1898 weakly excites
- L2:1334 weakly suppresses
- L1:1262 weakly suppresses
- L1:1960 weakly excites
- L1:87 weakly suppresses
- L1:1337 weakly suppresses
- L2:481 weakly excites
- L0:2322 weakly suppresses
Feeds later layers
- L22:814 excites
- L19:915 excites
- L4:259 excites
- L4:2730 excites
- L4:2590 excites
- L17:958 excites
- L4:1837 excites
- L26:1770 excites
- L23:2968 excites
- L4:2742 excites
- L24:1306 excites
- L22:1717 excites
- L20:1685 excites
- L4:1669 excites
- L4:2592 excites
- L21:1166 excites
- L4:2713 excites
- L24:2474 excites
- L21:2412 excites
- L21:406 excites
- L9:1869 excites
- L23:76 suppresses
- L4:1649 excites
- L26:1012 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- allele
- genomes
- genome
- 基因
- genome
- allele
- ensem
- alleles
- genes
- plemented
Suppresses
- 井
- lint
- 视线
- 册
- curl
- sales
- ष
- hat
- createForm
- InstanceState