'the' after 'of' in noun phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'the' when it follows 'of' in phrases like 'the nature of the', 'the severity of the' or 'the price of the'. It is most active in those phrases and is pushed the other way by 'the' after verbs or prepositions such as 'allows for the' or 'requiring the'. Turning it up did not clearly change the text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
good to soak chicken in cold water?⏎After two hours at room temperature you’d need to throw your raw chicken away. So technically it depends on the temperature of the water. If the water stays cold then you could keep the chicken there a long
-
with a brain herniation have:⏎A brain and nervous system (neurological) exam shows changes in alertness (consciousness). Depending on the severity of the herniation and the part of the brain that is being pressed on, there will
-
- Funding Research. One of Alice's responsibilities is to review technical reports and recommend further agency action based on the results of the reports. Due to the nature of the questions regarding the safety of the disposal site, traditional geologic methods do not always
-
The studio probably had little choice but to create a form letter.⏎I don’t think the form letter nature of the rejection is necessarily impersonal. It sticks to objective criticisms. Probably you can’t
-
(i.e. bolted, screwed, affixed, glued)? If it is, the property is considered personal property.⏎Intent: What was the intent of the property owner when he or she purchased the asset in question and brought it to his
-
with a futures contract, a buyer agrees to receive a security at a specified price and date. By buying a futures contract, you are betting that the price of the security will rise, allowing you to get a good deal later. By selling futures
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the question of the role of the use of a certain and the role of the use of a certain, but I don't think of the use of a certain. - this is a question of the use of a certain and the role of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
The Freedom of Information Act ("FOIA") is an act of Congress⏎codified in 5 USC, section 552. This Act allows for the full or partial⏎disclosure of previously unreleased information and documents controlled⏎by
-
1970 UNESCO Convention on the Means of Prohibiting and Preventing the Illicit Import, Export and Transfer of Ownership of Cultural Property was ratified by the
-
CAP) laws go one step further by imposing criminal liability to ensure that owners are held accountable for the security of their weapons.⏎The US Congress should pass legislation requiring the safe and secure storage of all guns and ammunition, and state legislatures
-
which they assist us in diagnosing and managing our health.⏎Table of Contents⏎Cancer is a disease that affects millions of people worldwide. It is characterized by the abnormal growth of cells in the body, which can invade and destroy surrounding tissues.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1317 weakly suppresses
- L0:774 weakly suppresses
- L0:2092 weakly excites
- L2:122 weakly excites
- L1:1758 weakly suppresses
- L2:1835 weakly excites
- L2:1878 weakly suppresses
- L1:2152 weakly excites
- L1:59 weakly excites 'the' after a verb or preposition
- L0:26 weakly suppresses
- L2:2810 weakly suppresses
- L0:1359 weakly suppresses
- L1:2725 weakly excites
- L1:297 weakly excites
- L1:1415 weakly excites
- L0:815 weakly excites
- L2:1514 weakly suppresses
- L1:1358 weakly suppresses
- L0:2313 weakly excites
- L0:483 weakly excites
- L0:1845 weakly excites
- L2:1960 weakly excites word endings in health and biology compounds
- L1:1980 weakly suppresses
- L2:710 weakly suppresses
Feeds later layers
- L8:369 weakly excites 'of' after 'learned' or 'because'
- L17:1592 weakly suppresses
- L14:2557 weakly excites
- L5:206 weakly suppresses
- L18:238 weakly excites
- L14:659 weakly suppresses
- L5:188 weakly suppresses
- L4:285 weakly excites
- L16:2844 weakly suppresses
- L6:439 weakly suppresses
- L6:914 weakly suppresses
- L20:743 weakly excites
- L21:316 weakly excites
- L19:2723 weakly excites 'of' after a quality or importance adjective
- L10:2730 weakly suppresses
- L18:3014 weakly excites
- L8:871 weakly suppresses
- L14:1389 weakly suppresses
- L5:586 weakly suppresses
- L7:2141 weakly excites
- L20:300 weakly suppresses
- L6:40 weakly suppresses
- L9:226 weakly suppresses 'to' starting an infinitive
- L26:2168 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- knobs
- uffed
- indsight
- zelf
- firm
- ivirus
- firm
- olicies
- configurations
- urrets
Suppresses
- -fetch
- 已经有
- dcc
- Into
- dda
- 背着
- 已经是
- あげ
- already
- 问我