unclear: 'the' inside 'end of' phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It fires on 'the' in ordinary phrases, like 'into the water' or 'of the Civil War', and it pushes strongly the other way on phrases like 'at the end of the' or 'leave the'. Turning it up or down produced no clear pattern in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
no problem hearing everything. When the bass and toms are added, conflicts begin to appear between the bass<|endoftext|>The Bruce-Benedicks Saga and the Birth of the AGH⏎While living in Paris in the 1880's,
-
should learn by the end of the second and third grade. Remember that these skills are not to be used in determining whether or not a child should be promoted to the next level but to get a better idea
-
plug the stem holding the water in then stand the flower upright in a vase of water.⏎- To increase the bloom time of cut flowers, plunge their stems into the water and let them stand overnight before arranging them. A crushed aspirin, a
-
collections to collaborate.⏎Organize your curriculum with collections. Easy!⏎Have time to be more creative & energetic with your students!⏎Students explore the Orange Revolution. In this Orange Revolution lesson, students examine the climate of the Ukrainian protest and investigate the role
-
@example.com.<|endoftext|>Table of Contents :⏎Top Suggestions Senior Kindergarten Writting Worksheet :⏎Senior Kindergarten Writting Worksheet In this worksheet your students will practice their handwriting skills by tracing the
-
on their solid oxide fuel cell, also known as a SOFC. The pilot system they built generates about 2 kW of electricity, or how much power a typical American home consumes. The PNNL team designed its system so it can be
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I think that the problem of the first order, the first order of the problem, I think that the problem of the first order, the first order, the problem, the answer, the question, the answer, it's the problem,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
- Real world examples of task models (from the travel, e-commerce, financial and automotive sectors), and the differences they've made to projects⏎Participants will leave the workshop armed with the ability to create their own task models and make a real difference
-
prepare and plan in conducting successful negotiations. It will also help participants gain greater insight into various negotiation issues currently involved in different WTO Agreements.⏎At the end of the course, the participants should be able to:⏎• Differentiate between bilateral and mult
-
least expects it. Paterson always establishes hope and optimism even in her most bleakly realistic stories, which dramatize internal and external conflicts. At the conclusion of the novel, Gilly still faces difficult choices, but she knows herself better and
-
explore some ways AI can help you create better content for your blog. We will cover everything from finding your niche to writing and editing your content. By the end of this post, you should understand how AI can help you take your content to the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:1405 suppresses
- L13:1100 excites
- L8:2755 suppresses
- L12:1906 weakly suppresses
- L13:1456 weakly excites
- L11:2037 weakly excites
- L4:968 weakly excites
- L8:1003 weakly suppresses "the" or "of" before a noun phrase
- L11:2497 weakly suppresses
- L7:790 weakly excites
- L9:2806 weakly suppresses
- L12:3004 weakly excites
- L13:956 weakly suppresses
- L13:210 weakly suppresses
- L12:2849 weakly excites '-based' after a place name
- L12:1065 weakly excites
- L6:1735 weakly excites
- L13:2594 weakly excites
- L9:1909 weakly excites
- L12:2176 weakly excites 'of' after a place or role noun
- L6:1218 weakly suppresses
- L12:2544 weakly excites
- L7:111 weakly suppresses
- L11:2207 weakly suppresses "of" after a noun in trademark and title phrases
Feeds later layers
- L19:1900 suppresses
- L18:1422 suppresses
- L16:371 suppresses
- L20:1983 suppresses
- L20:337 excites
- L20:714 suppresses
- L20:1233 suppresses
- L21:1119 suppresses
- L17:952 suppresses
- L21:368 suppresses
- L15:537 suppresses middle digits of numbers
- L16:938 suppresses
- L21:843 suppresses
- L20:254 weakly suppresses
- L18:77 weakly suppresses
- L21:309 weakly excites
- L17:265 weakly suppresses
- L16:2612 weakly suppresses
- L16:1643 weakly suppresses
- L19:638 weakly suppresses
- L16:2705 weakly suppresses
- L17:429 weakly excites
- L19:2609 weakly excites
- L19:932 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- desk
- unge
- ệt
- acht
- 胼
- ung
- дет
- ome
- urses
- erea
Suppresses
- >Last
- .Lookup
- 拿出来
- prestashop
- otti
- teardown
- 要说
- гон
- pulls
- .INSTANCE