'of' inside institution names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' inside the names of learned societies and academies, such as 'Royal Society of' and 'National Academy of'. It turns negative on words in app store names like 'App Store' and on 'deep web'. Turning it up gave text that did not match this theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
that is debt⏎Tc = corporate tax rate<|endoftext|>by Antony Williams PhD, Vice President of Strategic Development, Royal Society of Chemistry⏎When doodling in a planning meeting last year Professor Graham Richards of Oxford
-
⏎19.01.2017 | CeMM Forschungszentrum für Molekulare Medizin der Österreichischen Akademie der Wissenschaften⏎An important step towards a completely new experimental access to quantum
-
ontë's “Jane Eyre” — is considered an integral part of the literary canon, but what makes her so great?⏎In celebration of the Royal Society of Literature’s 200th birthday, and the 10th anniversary
-
parent” coal mining company.⏎The new corporation was to transact its business in Heilwood, Indiana County, Pennsylvania, but its initial stockholders and board of directors were once again (as with the Heilwood Coal Company) all from
-
8:15)⏎Paroh’s magicians could not duplicate the plague of Lice. They told Paroh that this plague was the “finger of the L-rd”. Rashi seems to indicate that the magicians were attesting
-
he was very influenced by romantic artists like Fuseli and Blake, as well as by his continued friendship with Coleridge. He was accepted to the Royal Academy of Art and did portrait and historical paintings. When in London he nearly finished a painting
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: --- *blank --- --- --- not
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
2009.⏎Entirely unregulated and decentralized, Bitcoin found popularity with deep web users who prized it for the pseudo-anonymity and ease of transfer. Before
-
cutest and silliest content that we could devise."⏎Cat Spanish is now available to download in the iTunes App Store for 99 cents. More languages are expected, but CatAcademy
-
and it won’t be so confusing. Instead of purchasing an app on a disk at the physical location of a store, you download them from the Windows 8 Store directly to your computer.⏎Check out this article from our archives to learn more about
-
|⏎Amazon Web Services (AWS) is a collection of remote computing services (also called web services) that together make up a cloud computing platform, offered over the Internet by Amazon.com. The most central and well-known of these services are Amazon EC
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:768 strongly excites
- L1:1508 strongly suppresses
- L6:719 excites
- L1:1390 excites
- L1:2988 excites
- L3:2042 excites
- L6:643 suppresses
- L10:1865 suppresses
- L5:1238 suppresses
- L0:1678 excites
- L5:2416 excites
- L10:1069 excites
- L7:1354 excites
- L5:2509 suppresses
- L10:803 excites
- L5:2900 suppresses
- L6:1528 excites
- L5:1136 suppresses
- L7:1540 weakly suppresses
- L10:1160 weakly suppresses
- L9:2580 weakly suppresses
- L4:1335 weakly excites
- L10:1498 weakly suppresses
- L9:2850 weakly suppresses
Feeds later layers
- L12:2033 strongly suppresses
- L16:2799 strongly excites
- L18:898 strongly suppresses
- L13:1698 excites
- L17:894 suppresses
- L14:1929 suppresses
- L15:1967 excites
- L17:1610 excites
- L18:2866 excites
- L15:3031 suppresses
- L14:935 suppresses
- L17:1120 excites
- L18:1782 suppresses
- L20:627 suppresses
- L18:814 suppresses
- L16:1635 suppresses
- L12:2554 suppresses
- L16:1460 suppresses 'of' after a group noun
- L13:1234 excites
- L12:571 excites
- L14:3038 suppresses 'the' after across, around or of
- L18:2530 weakly excites
- L17:1157 weakly suppresses
- L19:2340 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- lessness
- uo
- ところ
- fulness
- 埒
- 仅次于
- Enough
- arisen
- enton
- 溲
Suppresses
- esz
- krit
- cott
- 瑟
- änger
- 各
- ctl
- gaard
- 每人
- ']:⏎