'and' joining the last two list items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'and' that comes right before the final item of a list, like 'vitamins, minerals and' or 'pneumonia, diarrhea and'. Turning it up made the writing wander into repetitive, unrelated phrases.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
per year nationally. Thus, the research of cancer has always been popular, aiming at the development of safe and effective methods to prevent, detect, diagnose, treat and ultimately cure the disease.⏎As a trusted CRO, CD BioSciences provides
-
?” In this video, members of the Industrial Designers Society of America (IDSA.org) – a non-profit membership association dedicated to advocacy, education, community and information in industrial design – explain ID and its impact on our every day lives.⏎
-
the body regulates temperature, little is being done in the U.S. to better warn patients or physicians of the growing risks associated with climate change, doctors, researchers and community health experts said.⏎
-
be incorporated into cereal, buckwheat is most commonly used as a flour.⏎Buckwheat is considered heart healthy and is incredibly rich in minerals, nutrients and vitamins. Let’s break down the main nutrients that can be found in buckw
-
been found that apples are good for heart patients. It and keeps the digestive track balanced. The nutritional composition of apples is very rich in vitamins, minerals, carbohydrates and amino acids etc. Apples are also very good source of vitamin B-Complex
-
als is wheat bran cereal. It is produced from the outer layer of the wheat grain. The cereal has a rich content of protein, fiber, vitamins, minerals and phytonutrients. Vitamins include B1, B2, B3
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I think 37% of the people who are not really the ones who have been chosen, and I'm just guessing, but I need to be honest with the choices, and if it's not, then I need to be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
One little boy asked Scott Carpenter how his experiences as an "aquanaut" living inside the experimental underwater habitat Sealab compared to his experiences orbiting the Earth as an astronaut.⏎International Space Station crew member
-
in magnitude but have the same direction⏎D) not equal in magnitude but have opposite direction⏎E) None of the above⏎In a uniform circular motion, which of the following is constant?⏎A) centripetal acceleration⏎D) cent
-
. By examining your poop, you'll know what is happening on the inside.⏎Was last night's steak and potatoes a good choice? If your poop is smelly, a weird color, or if it has a gnarly shape - you
-
financial analysis of Common Core and determined that it would cost the state of Montana about $40 million to implement. Where will that money come from, and why wasn’t the legislature the body to decide if this was the right path for Montana schools
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:118 weakly excites
- L0:546 weakly suppresses
- L1:689 weakly suppresses
- L0:1224 weakly suppresses
- L1:1396 weakly excites
- L1:491 weakly excites
- L1:2174 weakly suppresses
- L0:1331 weakly excites
- L0:178 weakly suppresses
- L1:1246 weakly excites "word" after a language origin phrase
- L0:1301 weakly suppresses
- L1:1378 weakly suppresses
- L1:1973 weakly suppresses
- L0:605 weakly excites 'of' after an action noun
- L1:431 weakly suppresses
- L1:2376 weakly excites
- L1:2540 weakly excites
- L1:1554 weakly excites
- L1:955 weakly excites
- L1:51 weakly excites
- L0:801 weakly excites 'long' in 'how long' questions
- L1:2080 weakly suppresses
- L0:2820 weakly excites
- L1:671 weakly excites
Feeds later layers
- L4:121 suppresses
- L8:247 suppresses
- L14:1800 suppresses
- L9:173 suppresses
- L10:58 suppresses
- L3:1036 suppresses
- L8:145 suppresses
- L15:634 suppresses
- L11:533 suppresses
- L9:51 excites
- L11:826 suppresses
- L18:203 suppresses
- L17:301 suppresses
- L8:1535 suppresses
- L16:704 suppresses
- L17:349 weakly suppresses
- L3:157 weakly excites
- L12:1957 weakly suppresses
- L14:1811 weakly suppresses word before an evaluative adjective in essays
- L8:2023 weakly excites
- L17:357 weakly suppresses
- L18:364 weakly suppresses
- L24:174 weakly suppresses
- L11:131 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- فرد
- quires
- 开
- quired
- 珈
- 拿起
- board
- 加载
- za
- ubes
Suppresses
- angler
- iction
- WXYZ
- .getLongitude
- assertNull
- 呕吐
- uncture
- -Muslim
- respect
- ikt