mid-word pieces like 'advent' and 'precaution'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the middle pieces of certain longer words, especially 'vent' in 'Advent' and 'ca' in 'Precaution'. It is negative on pieces of medical and research terms such as 'sclerosis' and 'behavioral'. Turning it up or down changed the continuation, but the new text had no obvious link to these words.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Includes information on different styles of greenhouses, solar vs. supplemental heat, figuring costs, selecting a location, glazing, environmental controls<|endoftext|>Advent Reflections: Week 2, Day 5⏎“Moses said to
-
each module.⏎Share this pageToggle animations⏎Ninjas vs Superbugs⏎Adventures in NanomedicineWatch the video⏎- When Alexander Fleming discovered penic
-
Mystery' Bird Illness Continues, Tri-State May Put Bird Feeders Back Out With Precautions⏎The agency recommends thoroughly cleaning feeders at least once a week with a
-
, please remember to carry a converter!⏎Precaution 2: Choosing a power bank⏎So far, the standard voltage of
-
do not match, it may cause the appliance to burn or be damaged!⏎Precaution 1: When traveling⏎US sockets are generally 110V
-
when you're online to keep your identity safe.⏎- Only Make Purchases On Trusted Sites⏎When deals seem too good to be true, they just may
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about myself, and I have been thinking about myself. It's been thinking about myself. It's been thinking about myself. It's been thinking about myself. I have been thinking about myself. It's been thinking about
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ogenesis by modulating host immunity through the regulation of multiple metabolic pathways.⏎The “Gut Feeling”: Breaking Down the Role of Gut Microbiome in Multiple Sclerosis published in Neurotherapeutics gives an excellent overview of the body of knowledge being explored
-
help. The sooner you receive care for your anxiety symptoms, the better. Feel free to reach out to Neuro-Behavioral Clinical Research for help and information on anxiety.⏎RECEIVE A $7
-
can be used to<|endoftext|>| Trisha Sertori |⏎JUGA, Indonesia (Reuters) – The last time Wayan Rendeh took part in a temple ceremony
-
and treatments, rehabilitation, counseling, a full-time caretaker, inability to drive<|endoftext|>UK hydrogen cars are coming - if you can fill up⏎LONDON (Reuters) - Britain's hydrogen fuel cell car fleet may hit top gear within five years
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L4:3010 suppresses
- L3:936 suppresses
- L11:302 weakly suppresses
- L1:1958 weakly excites
- L17:2949 weakly suppresses 'for' introducing an example or reason
- L9:1850 weakly suppresses
- L2:2800 weakly suppresses
- L5:2032 weakly excites
- L6:470 weakly suppresses
- L22:1357 weakly excites
- L15:921 weakly excites
- L18:186 weakly suppresses
- L5:1124 weakly suppresses
- L15:477 weakly suppresses
- L4:2218 weakly excites
- L24:1532 weakly excites
- L7:390 weakly suppresses
- L18:2521 weakly suppresses
- L10:2970 weakly excites
- L19:1289 weakly suppresses
- L24:2594 weakly suppresses
- L4:365 weakly excites
- L2:1826 weakly excites
- L10:2412 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- dojo
- edo
- UserDao
- uche
- aldi
- bsites
- udo
- Wrest
- фор
- ELY
Suppresses
- sav
- _endian
- thing
- rest
- increased
- thing
- increases
- �单
- multiple
- phục