unclear: words inside technical terms
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The pattern is hard to pin down. It fires on pieces of specialist terms, such as the 'acet' in thallium acetate or the 'epith' in epithet, but the examples do not share a clear theme. Turning it up made the text repeat words like 'pair' and 'call'.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
from its application. In 1938, “Kormelu,” a depilatory cream, was being sold with the active ingredient thallium acetate.(3) Thallium acetate is used to kill rats and was
-
and desires. Reason comprises conception, judgment, reasoning, and the intuitional faculty. Specifically, it is the intuitional faculty, or the faculty of first truths, as distinguished from the understanding
-
emergency kits for home and school.<|endoftext|>|This article needs additional citations for verification. (July 2012) (Learn how and when to remove this template message)|⏎Sendust is a magnetic metal powder that was invented by Hak
-
he was noted for his lack of military skill, and his controversial command of New Orleans, which brought him wide dislike in the South and the "Beast" epithet. He helped create the legal idea of effectively freeing fugitive slaves by design
-
example?⏎Surname is defined as the family or last name. An example of a surname is Smith when the person’s full name is John Smith. A nickname or epithet added to a person’s name.⏎What is surname in Tagalog?⏎Translation
-
Robert Winglee of the University of Washington, Seattle, calculated that some parts of the moon spend about a quarter of the moon's orbit protected by Earth's magnetosphere (Geophysical Research Letters, DOI: 10.102
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: opening location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location location
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the driving force behind founder and CEO Melissa Clark-Reynolds’ decision to create MiniMonos in the first place. After Melissa saw the movie ‘An Inconvenient Truth’, she decided to contact ex-US Vice President Al Gore to offer her
-
19. The massacre took place in a public park called Jallianwala Bagh in the city of Amritsar where British Indian army’s Colonel Reginald Dyer on 13 April 1919 ordered his
-
there’s a big difference: you can knock your opponents’ rocks away from the target, like the balls in croquet. Also, there are four people to a team, and a team leader called the skip, who yells instructions at the
-
most burials are carried out by members of the Ebola response team. But these measures have created a sense of mistrust between community members and health workers.⏎A Congolese psychologist and counselors at a group called the Bethesda Counselling Centre are helping
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:889 excites
- L21:1888 suppresses
- L25:284 suppresses
- L24:153 suppresses
- L24:489 excites
- L23:79 excites
- L20:602 suppresses
- L19:1427 excites
- L22:260 suppresses
- L18:216 excites
- L15:184 suppresses
- L25:390 suppresses
- L20:1047 suppresses
- L19:1804 suppresses
- L19:1180 suppresses
- L18:1433 suppresses
- L21:592 excites
- L7:92 suppresses
- L22:2089 excites
- L21:68 excites
- L19:2956 weakly excites
- L10:365 weakly suppresses
- L21:338 weakly excites
- L22:760 weakly excites
Feeds later layers
- L27:478 weakly suppresses
- L27:2393 weakly suppresses
- L27:1586 weakly excites
- L27:2658 weakly suppresses
- L27:740 weakly excites
- L27:2732 weakly suppresses
- L27:2804 weakly suppresses
- L27:754 weakly suppresses
- L27:1452 weakly suppresses
- L27:72 weakly suppresses
- L27:2365 weakly excites
- L27:1582 weakly suppresses
- L27:793 weakly excites
- L27:1106 weakly suppresses
- L27:2921 weakly excites
- L27:2995 weakly suppresses
- L27:465 weakly suppresses
- L27:1485 weakly suppresses
- L27:2043 weakly suppresses
- L27:2985 weakly excites
- L27:2959 weakly suppresses
- L27:1908 weakly suppresses the 'd' that starts 'die' or 'dead'
- L27:914 weakly suppresses
- L27:2632 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- call
- 对
- Pairs
- pairwise
- rule
- hof
- ОС
- pairs
- comes
- AGMA
Suppresses
- ards
- ategory
- incarnation
- utos
- elope
- lland
- opening
- eler
- การ
- lero