mid-word syllables in capitalised names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the middle pieces of longer names and words, especially ones that start with 'Al', 'Ba' or 'El', such as ALBANIA, Balboa, Albatross and Elbe. When it was turned up, the model's writing did not visibly change in any clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
other technologies are used in this course. This course fulfills the graduation requirement for fine and/or practical arts.<|endoftext|>|Albania Table of Contents⏎ALBANIA WAS THE LAST COUNTRY in Eastern Europe during the early 19
-
dernière mise à jour : 05/07/2021⏎Ajouter un commentaire<|endoftext|>By DANIEL SUDDEATH⏎NEW ALBANY —⏎Judging by the pleasure clearly shown by the children as they whe
-
of The World As It Could Be Tree Dedication Ceremony, students, teachers, and other collaborators on the project reflect on the Universal Declaration of Human Rights. Balboa High School Tree Ceremony from BAYCAT.<|endoftext|>Several images have been returned to
-
ceptor Group, his fifth combat victory of the Korean War. Green safely ejected and was rescued from the Yellow Sea by an Air Rescue Service SA-16 Albatross flying boat.⏎Captain Fedorets closed on McConnell from
-
The Hobbit”” Smeagol is portrayed as destructive and contemptuous in that he tries to eat Bilbo a fellow hobbit only since he needs something to eat and raw fish are entirely
-
, removing the silt from the channel, the dock and the harbor entrance. For example, the entrance of Port of Hamburg located in the estuary of Elbe River in German, the Port of Rotterdam in the Netherlands and the Port of Ant
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately, and I have been thinking about lately. What do you think about the latest updates on this topic? What have you thought? What have you thought? What do you think about the latest updates on this topic
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of Health and Human Services Division of Public Health as well as data from the North Carolina Birth Defects Monitoring Program.<|endoftext|>BARLEY (Hordeum vulgare)⏎Requires six hours or more⏎of strong, direct sun per day.⏎
-
artan steel and concrete. None of the statuary of mermen on dolphin and allegorical sculptures are present in today’s Jones Bridge.⏎Puente de Colgante⏎The construction of the Puente Colgante was completed in 1
-
Art.⏎There are no reviews yet.<|endoftext|>The first three bridges that spanned across the Pasig River were the Puente Grande, Puente de Colgante and Puente de Ayala.⏎Built in 1632,
-
As the name suggest, Puente Colgante was the first suspension bridge to be built in the country. It is known
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:178 suppresses
- L0:1224 suppresses
- L0:1301 suppresses
- L0:512 weakly suppresses
- L0:979 weakly excites
- L0:718 weakly suppresses
- L0:497 weakly suppresses
- L0:435 weakly suppresses
- L0:1441 weakly excites
- L0:1 weakly suppresses
- L0:1807 weakly suppresses
- L0:2317 weakly excites
- L0:1390 weakly excites
- L0:210 weakly suppresses
- L0:2682 weakly excites
- L0:1634 weakly suppresses
- L0:1365 weakly excites
- L0:257 weakly excites
- L0:2899 weakly excites
- L0:823 weakly suppresses
- L0:1696 weakly excites word endings like 'ed' after a stem
- L0:112 weakly suppresses
- L0:2456 weakly excites
- L0:735 weakly excites
Feeds later layers
- L9:2257 weakly excites
- L12:1003 weakly suppresses
- L27:1552 weakly excites
- L6:1317 weakly suppresses "than" after "more to it" comparisons
- L27:2457 weakly excites
- L7:375 weakly suppresses
- L7:2645 weakly excites
- L23:1555 weakly excites
- L5:2492 weakly excites
- L9:1598 weakly suppresses
- L11:161 weakly excites
- L9:1396 weakly suppresses
- L9:2255 weakly suppresses
- L8:1455 weakly suppresses
- L22:1843 weakly suppresses
- L10:2161 weakly excites
- L21:2696 weakly excites
- L2:2253 weakly suppresses
- L3:2892 weakly suppresses
- L24:2090 weakly suppresses
- L4:1096 weakly excites
- L11:918 weakly excites
- L4:1133 weakly suppresses
- L2:577 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 讫
- ght
- ippers
- $obj
- 利物
- 롤
- $"
- tatto
- _taken
- oin
Suppresses
- afirm
- ?=.*
- WATCH
- orgen
- ampus
- .isArray
- 生活水平
- busters
- евич
- WATCH