'to' in 'person to person' phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'to' in repeated phrases like 'person to person' or 'year to year', where the same noun comes before and after. Its negative side is weak and fires on the start of the word 'treating'. Turning it up gave general, wandering text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
can be a major concern for patients. The pain associated with dentin hypersensitivity is usually brought on by an external stimulus, and the intensity can differ from patient to patient. The diagnosis of dentin hypersensitivity often poses a challenge for the dental
-
and use other trees for resting and habitat.⏎It's important that they have protection in undergrowth whilst moving from tree to tree, so the use of smaller shrubs is vital.⏎For the most recent
-
notice a strong urine smell. First, think about the amount of water you’ve drunk in the last couple of days. Even though the amount can vary from person to person, as a general rule it’s best to drink 8 glasses of water
-
is successful, you will continue maintenance shots for three to five years.⏎How well do these shots actually work?⏎As with any treatment, effectiveness will vary from person to person. They have been shown to aid in the decrease of symptoms for many different
-
as a result.⏎ADHD (attention deficit hyperactivity disorder) is characterized by inattention, impulsiveness and hyperactivity; however, the symptoms vary from person to person and often also include emotional instability.⏎You
-
however, when James Kirk took command, and ordered a pursuit of the Narada toward Earth. (Star Trek)<|endoftext|>It's just fluctuating wildly from year to year as it always has done but by making some complex "allowances", climate
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been in the process of a very different kind, and I have been in the process of a very different kind. So, I have been in the process of a very different kind. So, I have been in the process of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
drug ineffective after several applications.⏎Treatment of Attention Deficit Hyperactive Disorder (ADHD)⏎ADHD is not uncommon in children with Tourette's syndrome. Treating the deficit in attention as well as the hyperactivity with medications such as methylphen
-
New England Journal of Medicine.⏎“Treating the health care system like a (wildly inefficient) jobs program conflicts directly with
-
its or if the vomiting is joined with diarrhoea, lethargy or changes in her behaviour, you should contact your vet as soon as possible. Treating your dog's vomiting with medication or other steps largely depends on the cause of the
-
. Physiotherapists treat Bell’s palsy and nerve injuries with electrical nerve stimulation therapy where a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1657 excites
- L1:2801 weakly excites
- L1:1029 weakly excites
- L0:178 weakly suppresses
- L0:1301 weakly suppresses
- L0:1224 weakly suppresses
- L2:2260 weakly excites 'a' after 'in' or 'such'
- L2:1287 weakly excites
- L2:2488 weakly suppresses
- L2:481 weakly excites
- L1:863 weakly excites
- L2:2366 weakly excites
- L2:111 weakly suppresses
- L2:478 weakly excites
- L2:75 weakly suppresses
- L0:949 weakly suppresses
- L2:1797 weakly excites
- L1:1234 weakly suppresses
- L1:2922 weakly excites
- L1:1464 weakly excites
- L1:2463 weakly excites
- L2:1010 weakly excites
- L1:2469 weakly suppresses
- L0:616 weakly excites
Feeds later layers
- L5:2403 suppresses
- L8:2593 excites
- L4:117 weakly excites
- L20:3004 weakly suppresses
- L16:2230 weakly suppresses
- L22:2677 weakly excites
- L7:662 weakly suppresses
- L15:2276 weakly suppresses
- L5:1617 weakly excites
- L16:1789 weakly excites
- L24:1409 weakly excites
- L25:618 weakly excites
- L4:2194 weakly excites
- L4:1767 weakly excites
- L8:2776 weakly excites
- L10:1653 weakly excites
- L11:749 weakly excites
- L6:1075 weakly suppresses
- L8:471 weakly suppresses
- L4:2951 weakly excites
- L4:2143 weakly excites "in some" opening a qualifier
- L4:1402 weakly suppresses
- L25:2403 weakly excites
- L4:2120 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ocks
- Mb
- )m
- }s
- preneur
- ��
- strap
- __;⏎
- bler
- $is
Suppresses
- PUT
- średni
- PUT
- leases
- 发烧
- programming
- 白银
- Titan
- tc
- known