unclear: sentence ends in web articles
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop or line break that closes a sentence in ordinary web text, such as encyclopedia or health articles. The pattern is loose and the snippets do not share a clear topic, and turning it up did not produce an obvious change in the story the model wrote.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
area than any other climate grouping. They occur in both tropical and middle latitudes. They cover broad east-west bands near 30 degrees north and south latitude.⏎Middle latitude semiarid and desert climates are in the rain shadows of mountain ranges
-
Type IIModerate sulfate resistance Type IIAModerate sulfate resistance, air-entraining Type II (MH) Moderate heat of hydration and moderate sulfate resistance⏎Types
-
created the model train as well as soon model train tracks were painted and also laid on railroad tracks. The tracks were used by digital photographers to make art works on.⏎Digital photography developed into a business task when photographer started using camera lenses. Lens made
-
avirus infections. This virus is to blame for the bulk of common colds. Frozen, slushy fruit juices will usually facilitate to appease a sore throat.⏎When experiencing cold and respiratory disease symptoms, it’s vital to remain hydrated. Fl
-
began to terrorize Iraqi cities and towns. Al-Qaida in Iraq recruited from other countries to build its influence and keep a democratic nation from arising in the region.⏎As the challenges of helping to form a free Iraq began to
-
A collection of worksheets that cover all learning areas is simpler for you to collaborate with, and will certainly use up much less of your time than searching for individual worksheets.⏎This sounds like a horrible lot, does not it! A great collection of preschool
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am going to do something in the last year. I will have to do something else. The other thing is to do something. The other thing is. I will have to do something. This is a good thing. The user is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
with an emphasis on fundamental data structures⏎- object-oriented programming⏎- event-driven programming.⏎At least some portion of a study should be devoted to object-oriented programming.⏎Note About Coding⏎Computer programming is one step in the software-development process; it
-
is the soft under plumage that serves as insulation beneath the outer feathers of ducks and geese. Generally, down comes from the underbelly of these animals. Because they are light, fluffy, quill-free, and insulating, they
-
ground, Jackdaws have an upright posture and strut about briskly, their short legs making their gait rapid. They feed with their heads down to horizontal. Sexes and ages are alike.Jackdaws undergo a complete moult from
-
called catharsis, and it is part of the healing process. These emotions are often extremely powerful. Fear, despair and anger are commonly associated with this stage. Hypersensitivity, acting out, and venting are
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:399 excites
- L10:1224 suppresses
- L6:216 excites
- L6:871 suppresses
- L11:244 excites
- L9:2729 suppresses
- L11:1595 excites
- L9:25 excites
- L6:305 suppresses
- L9:250 suppresses
- L9:159 suppresses
- L3:1093 suppresses
- L8:573 excites
- L11:558 suppresses
- L11:1818 suppresses
- L6:244 excites
- L11:567 excites
- L2:80 suppresses
- L9:2447 weakly excites
- L6:286 weakly excites
- L10:259 weakly excites
- L9:2259 weakly excites
- L10:494 weakly suppresses
- L3:555 weakly excites
Feeds later layers
- L13:1968 suppresses
- L13:1187 suppresses
- L14:904 excites
- L14:398 suppresses
- L17:1299 excites
- L15:2372 suppresses
- L15:264 suppresses
- L13:2156 suppresses
- L15:1332 suppresses
- L14:762 excites
- L15:2505 suppresses
- L14:424 suppresses
- L15:2031 suppresses
- L16:970 excites
- L13:1148 suppresses
- L13:2071 excites
- L13:2095 suppresses
- L16:397 weakly excites
- L16:2021 weakly suppresses
- L17:2058 weakly suppresses
- L17:925 weakly excites
- L14:949 weakly suppresses
- L13:970 weakly suppresses
- L20:699 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- strings
- пут
- głównie
- Dort
- levard
- inary
- shot
- aturas
- Lens
- 这样的
Suppresses
- iggs
- .]⏎⏎
- }],⏎
- ."},⏎
- .⏎⏎
- grate
- ."⏎⏎
- ties
- ].⏎⏎
- oga