'of' after office and division titles
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the word 'of' inside the names of government posts and organisations, such as 'Minister of', 'Division of', 'House of' or 'National Museum of'. Turning it up did not make the replies visibly about government or organisations.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
came to India in 1917 after acquiring a high degree of doctorate in economics from Britain.⏎According to his agreement, he worked as the Minister of Finance in the princely state of Baroda for some time. But he did
-
apeake. It can take from four to six years for a female striped bass to reach sexual maturity.⏎Dan McKiernan, deputy director of the state Division of Marine Fisheries, called the low index troubling and
-
week, show your support with the hashtag #EveryoneBenefits and tell us why gender equality is important to you.⏎The Honourable Maryam Monsef, Minister of Status of
-
science editor at Smithsonian.com, will moderate a discussion and audience Q&A. This program is part of the National Museum of Natural History’s Earth’s Temperature History & Future Symposium March 29-3
-
the Willowbrook Wildlife center on how to prevent and deter skunks from your property humanely. Any⏎resident in need of additional assistance should contact the Assistant Director of Village Services, to have the Village inspect their property for additional guidance and options.
-
, which makes laws binding throughout Nigeria on matters not granted to state governments by the Constitution, is called the National Assembly. It consists of two chambers: the House of Representatives and the Senate.⏎The executive branch of government is headed by the President,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the problem of a person who has been given a task to look at a particular piece of information it's possible to think about a task this is a very important task this is a task this is the task this is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
paper in Word format. Apply APA standards to citation of sources. Use the following file naming convention: LastnameFirstInitial_M5_A1.doc.⏎By Saturday, August 16, 2014, deliver
-
indicate the real role of mammals as T. cruzi reservoirs and transmitters. Here, two species of mammals, white-nosed coati (Nasua narica) and raccoon (Procyon lotor), were examined for
-
inctus in Central and South America, but only one subspecies, D. n. mexicanus occurs in North America.⏎DISTRIBUTION: Dasypus novemcinctus mexicanus’ original distribution was from the lower Rio
-
indicates that tyrannosaurid dinosaurs (the group of tyrannosaurs that includes T. rex) likely evolved in isolation on this island continent. Lythronax stands out from its contemporaries in having a much wider skull at the eyes and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:861 suppresses
- L8:459 suppresses
- L9:1190 suppresses
- L6:2114 excites
- L11:1194 excites
- L3:169 suppresses
- L7:900 excites
- L5:747 excites
- L11:2713 suppresses
- L9:2193 weakly excites
- L2:3 weakly excites
- L10:85 weakly excites
- L4:587 weakly excites
- L5:716 weakly suppresses
- L11:832 weakly excites
- L6:3018 weakly excites
- L6:2959 weakly suppresses
- L5:212 weakly suppresses
- L9:2005 weakly excites
- L5:1286 weakly excites
- L11:3011 weakly excites
- L4:186 weakly suppresses
- L9:2619 weakly excites
- L10:516 weakly suppresses
Feeds later layers
- L13:2408 excites
- L25:67 excites
- L21:185 suppresses
- L24:43 excites
- L24:2469 suppresses
- L21:959 excites
- L24:512 excites 'the' inside organisation and convention names
- L20:1002 suppresses
- L27:16 excites
- L22:430 excites
- L14:1972 suppresses
- L27:53 suppresses
- L27:12 excites
- L27:91 excites
- L27:535 excites
- L24:26 suppresses
- L25:455 excites
- L21:846 excites
- L19:1941 excites
- L20:661 excites
- L22:233 excites
- L23:278 excites
- L27:640 excites 'of' inside fixed titles and names
- L26:782 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- {"
- .Ex
- Free
- Ex
- ющим
- 系列
- Master
- ***
- *
- Valley
Suppresses
- 一篇文章
- languages
- 辆车
- _jobs
- oğlu
- IsNull
- schools
- companies
- características
- htags