comma after an introductory time phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the comma that ends an opening phrase like "Over the past decade," or "Under this pressure,". On the negative side it reacts to the "'s" in "this week's". Turning it up did not produce text that clearly reflects this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
pain of loneliness. So closely entwined are their lives that a number of evolutionary biologists argue that dogs and humans have evolved together.⏎Over the past decade, a loose-knit band of scientists in laboratories in the United States and abroad have
-
East and North Africa (MENA), women have made progress toward establishing equal access to economic opportunities, especially with regard to access to education. Over the past decade, MENA governments have invested about 5.3 percent of their GDP in education
-
overlooked for their gender, pushed to the sidelines due to widely prevalent sexist attitudes and societal pressures to keep women in the home.⏎Over the coming month, almost 200 concertos to the A Seat at the Piano will be
-
number of transplants has barely gone up. So this is now a public health crisis.⏎Surgeon and Professor of Urology⏎Over the past decade, 3D printing has garnered considerable attention due to its broad applications, its ease
-
if this copyright notice is maintained. Any other reproduction is prohibited without permission Copyright information for reviewers⏎Young Canada Works<|endoftext|>From the Publisher:⏎Over roughly the past decade, oil and gas production
-
Clean Water Act is applied to all waters, farmers and ranchers would be significantly impacted due the number of farming activities that would require permits.⏎Under this new law, areas that contain water only during a rain would be subject to full federal regulation.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I will be thinking about lately" and "I have been thinking about lately". So, for example, if you want me to think about this. I have been thinking about lately. So, for example, if you want me to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.xlsx file.) How does the Fishers test support your conclusion? (Note: Consider the categories of the three majors to be your treatments.)<|endoftext|>During this week's close encounter with Earth, astronomers tracked the aircraft-carrier-sized asteroid 20
-
⏎The prospect of untreatable gonorrhoea has provoked alarm around the world, and there are no new classes of antibiotics in development.⏎In this week's Scrubbing Up column, Peter Greenhouse of the British Association for Sexual Health
-
lunch and dinner; this avoids unnecessary stops for quick snacks on the way home, e.g. crisps or chocolate bars.⏎Bus and Train<|endoftext|>In this week’s edition of the Breitbart News Culture Challenge, we’re spotlighting the best and most
-
Thomas Jefferson’s historic Virginia Statute for Religious Freedom, a precursor to the religious liberty protections in the First Amendment to the U.S. Constitution.⏎In this year’s Religious Freedom Day proclamation, President Barack Obama writes,⏎Today, America embraces people of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:831 weakly suppresses
- L0:1724 weakly excites
- L0:1187 weakly excites
- L0:1330 weakly suppresses
- L0:2910 weakly excites
- L0:2296 weakly suppresses
- L0:2501 weakly suppresses
- L0:612 weakly excites
- L0:2018 weakly suppresses
- L0:601 weakly suppresses
- L0:319 weakly suppresses blank space after a label colon
- L0:1245 weakly suppresses
- L0:1518 weakly excites
- L0:1646 weakly suppresses
- L0:1039 weakly suppresses "and" closing a number range
- L0:2189 weakly suppresses
- L0:637 weakly suppresses
- L0:2027 weakly suppresses
- L0:40 weakly excites 'of' in 'sort of' hedges
- L0:1579 weakly suppresses
- L0:474 weakly excites
- L0:353 weakly suppresses
- L0:864 weakly suppresses
- L0:2570 weakly excites
Feeds later layers
- L2:1330 excites
- L6:918 weakly excites
- L12:1352 weakly excites
- L2:891 weakly excites
- L16:922 weakly suppresses
- L9:1192 weakly excites
- L18:1370 weakly excites
- L18:999 weakly excites
- L21:96 weakly excites
- L15:1571 weakly suppresses
- L7:419 weakly suppresses
- L7:848 weakly excites
- L20:1800 weakly suppresses
- L16:2688 weakly suppresses
- L10:2489 weakly suppresses
- L2:259 weakly excites
- L18:382 weakly suppresses
- L17:2425 weakly excites
- L16:797 weakly suppresses
- L14:655 weakly excites
- L16:140 weakly excites
- L27:545 weakly excites
- L15:452 weakly excites
- L12:2535 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- eba
- för
- .MustCompile
- -decoration
- orns
- -over
- [](
- borg
- forces
- łów
Suppresses
- 和他的
- atedRoute
- reign
- 跟她
- 之战
- Workplace
- hecy
- 澍
- 副市长
- sạn