unclear: mid-phrase words before a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a word in the middle of a sentence, often the word just before a noun like 'time', 'song' or 'music'. The pattern is loose, and turning it up just made the model's text wander off topic.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
him/her and will learn to crawl, stand and eventually walk.⏎Why is tummy time important?⏎Infants spend a lot of time lying on their back, especially a few weeks after being born. If they’re
-
the South in the 19th century with the emergence of the Atlantic Slave trade. It was during this time that thousands of Africans were moving to America with music influences from their native
-
with your melody, but, in most cases, they won't match up perfectly. The melody should usually take precedence over the lyrics, as the tune of the song is more
-
choice continues until the acquisition of another domicile of choice.⏎1. Domicile of choice: acquire when abandon previous domicile, arrive in the new domicile (must have some physical presence), and intend to remain in new domicile for
-
which is done on windy days, is also a memorial of this celebration.⏎Iranologists have two doubts about the timing of this celebration. The first group believes that this celebration has been held in Badruz since January, and within a week of its
-
scientists at Warwick pushed the limits of imaging the olympicene with their microscopy equipment they contacted the IBM scientists in an attempt to see whether they could use their technique for even greater resolution. The result? A beautifully rendered image of a single molecule
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 3D structure, a 2D structure, and a 4D structure, with the following properties: - The total volume is 1,000,000,000,00
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
matters.⏎If a limited partner assumes an active role in management, that partner may lose his limited liability protection and may be treated as a general partner. For instance, if a limited partner negotiates a contract with a third party on behalf of the
-
with a possibly faulty mass air flow sensor.⏎Sometimes these symptoms may be due to other reasons, but you should still have your mass air flow sensor inspected if you experience at least a few of these symptoms that are listed below.⏎1) Lean Id
-
a copyright-protected document to tell the story. Another example of "fair use" is when a university professor quotes several sentences from a copyright-protected book in a review<|endoftext|>Sixty-three men from the parish lost their lives in the war.
-
understanding can lead to relief from pain, stress and tension, increase energy, improve coordination and enhance performance skills.⏎Study with Molly in Kansas City or bring her to you……anywhere on this beautiful planet.⏎Alexander Technique Choreography Dance Movement Performance<|endoftext|>
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2214 excites
- L13:922 suppresses
- L13:671 excites unclear: maintenance, safety and process nouns
- L10:2177 excites
- L10:2018 suppresses
- L13:138 excites
- L11:2039 excites
- L13:1298 suppresses
- L11:663 excites
- L12:1489 excites
- L12:1757 suppresses
- L12:2236 suppresses
- L13:1915 excites
- L11:679 suppresses
- L10:1851 excites
- L13:832 excites
- L12:1586 excites
- L13:1717 excites
- L12:2565 weakly suppresses
- L13:662 weakly excites
- L13:2031 weakly excites
- L11:1649 weakly excites
- L13:2508 weakly excites
- L12:1571 weakly excites
Feeds later layers
- L15:1807 excites
- L17:2220 excites
- L15:1076 excites
- L16:2084 excites
- L15:2241 excites
- L16:1207 excites
- L16:713 excites
- L18:2515 excites
- L15:2096 suppresses
- L15:2838 excites
- L16:403 weakly excites
- L16:2426 weakly excites
- L16:1995 weakly excites
- L21:1080 weakly suppresses
- L15:2588 weakly excites
- L16:2753 weakly excites
- L18:2903 weakly excites
- L15:2816 weakly suppresses
- L19:700 weakly excites
- L15:2420 weakly excites
- L18:2797 weakly excites
- L19:2430 weakly excites
- L16:1342 weakly excites
- L18:3008 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- атор
- ادية
- ricular
- ETY
- atory
- atoria
- руч
- ickness
- ordable
- EGIN
Suppresses
- 咫
- maxi
- utas
- nextState
- 笑脸
- quila
- mates
- major
- knowledge
- 饱