'therefore' or 'thus' after a subject
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on words like 'therefore' or 'thus' that come right after the subject of a sentence in formal, science-style writing, where a conclusion is about to follow. Turning it up made the model's text drift toward unrelated question-and-answer style sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
advantage of this unique research platform to measure greenhouse gases and aerosols, such as particulate matter,⏎as well as to verify Dutch and European emissions. It is therefore making a key contribution to two European research infrastructures: ICOS
-
CHR) in minor head injury is an evidence-based aid in decision making as regards to use of CT-scans to detect head injury requiring neuro-intervention. It therefore avoids wastage of resources. The objective was to compare the number of CT-sc
-
the hepatic vein.⏎It should be noted that during the process of clearing the body of toxins, the liver is damaged by exposure to harmful substances. The liver therefore possesses the amazing ability to self-repair and regenerate of damaged tissues.⏎So as
-
as "Lunda-designs". The Tchokwe are descendants of the Lunda people, and live predominantly in a region today called Lunda, hence the⏎name Lunda-design to honour my source of inspiration.⏎The picture below presents
-
canal treatment) is a dental technique that provides dead or inflamed teeth. The bacteria are removed with special instruments and the function of the tooth is restored. He therefore does not have to be drawn. Successful root canal treatment can preserve the tooth for
-
considerable economic importance. They are built in their hundreds of thousands every year, and have a history extending back to the 1920s. It is therefore surprising there have been so few books dealing in any depth with solid-state
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I know that, for example, in a certain kind of mathematical structure, that is, that is, that is the structure of, that is, that is the structure of a group, that is, that is the structure of a group
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
fracture and it becomes much more straightforward for health care professionals to follow an appropriate standard of care in order to best treat the injury. To provide you with more information so that you may better understand whiplash injuries and how they should be treated,
-
of capturing the beasts is recorded in several Roman mosaics.⏎The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you
-
Collagen, five primary ones are the most important here.⏎Type I: This type accounts for 90% of the collagen in your body. These give form and structure to the bones with calcium, skin, arteries, tendons, scar
-
, the U.S. Department of Agriculture Food Safety and Inspection Service warns against using these as a fruit and vegetable wash for your fresh
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:1112 strongly excites
- L6:2530 strongly suppresses
- L7:2662 excites
- L6:2753 suppresses
- L4:1529 excites
- L6:2820 suppresses
- L7:1253 suppresses
- L9:212 suppresses
- L7:2470 suppresses
- L7:625 excites
- L9:298 suppresses
- L5:1035 excites
- L7:104 excites
- L7:627 excites
- L8:1885 weakly suppresses
- L3:2565 weakly excites
- L4:386 weakly excites
- L6:2050 weakly suppresses
- L6:1575 weakly excites
- L7:1234 weakly suppresses
- L6:1485 weakly excites
- L7:912 weakly suppresses
- L6:1802 weakly suppresses
- L8:133 weakly suppresses
Feeds later layers
- L15:1116 excites
- L14:665 suppresses
- L15:2554 excites
- L13:1727 excites
- L12:2704 excites
- L15:3012 excites
- L12:144 suppresses
- L13:3023 excites
- L12:2151 excites
- L15:2624 excites
- L15:516 suppresses
- L16:1241 excites
- L12:2436 excites
- L16:2425 excites
- L19:3020 excites
- L13:181 suppresses
- L17:3032 excites
- L16:2177 excites
- L15:1854 excites
- L14:628 excites end of document boundary token
- L13:804 excites
- L19:1478 suppresses
- L12:2968 weakly excites
- L17:1448 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ffield
- :title
- entially
- Lilly
- .addField
- ettle
- getField
- :url
- xDD
- 走上
Suppresses
- 又是
- 又能
- _again
- 貫
- |
- 件
- itori
- uno
- enade
- ograms