period ending a contact or help sentence
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop or exclamation mark that ends a sentence inviting the reader to get in touch or ask questions, such as 'contact us today.' Steering had no clear effect on the topic of the text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Contact Air Care Heating And Air Conditioning⏎For more information on the best humidity for your home, or to schedule an HVAC appointment, contact us today by clicking here.<|endoftext|>[authors: Barbara Reedy; Michael Reedy]⏎“The history of the
-
sufficient.⏎Of course the best way to see where the Ganges river is by using a map of the River Ganges.⏎I hope this answers your question Rebecca. You can find out more information on the River Ganges by looking at more information
-
you interested in visiting places that have been abandoned? Or is it too creepy? Have you been to any that you can add to the list? Please share below!<|endoftext|>How to tell if lines
-
transaction that comes their way. If you cheat, your transaction does not get forwarded.⏎I hope that explains the concept of how Bitcoin works in regards to your question. Just to be clear:⏎"Does each bitcoin has a unique identifier,
-
atures LibGuide. Contact Sue Samson, firstname.lastname@example.org, with questions or for more information on how this database can help you with your research or teaching.<|endoftext|>Iris is technically the Greek goddess of messages, the sky, and the
-
supported by Campus Ambassadors, Students Against Slavery and Willamette University's Religious Studies Department.⏎For more information contact Jessica Sternbach at firstname.lastname@example.org.<|endoftext|>St. Peter's Cathedral is one of the most significant buildings inside the Vatican
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first and the second term of the sequence. But I can't think of a term which is a prime number. But wait, I have a prime number in the first term. But the first term is 2, which is a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
The second generation consist of the muon (μ−⏎) and muon neutrino (νμ⏎) The third generation consist of the tau (τ−⏎) and the tau neutrino (ντ⏎). Each type of neutr
-
least developed countries as regards multilateral negotiations;⏎• Formulate a sound negotiation strategy;⏎• Analyze the significance of data required for a multilateral trade negotiation; and⏎• Assess various issues that may arise during negotiation
-
Python.⏎Assign strings to variables and use them to print output at certain stages of the program. For example:⏎>>> >>> s1 = 'String in single quotes' >>> s1 'String in single quotes' >>> >>> s2 = "String
-
to the bumper itself. …⏎- Valance Panel. …⏎- Inner Fender. …⏎- Fender. …⏎- Cowl Panel. …⏎- Door. …⏎- Lower Door Skin.⏎Why are car bumpers
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:660 suppresses
- L20:561 excites end of document marker
- L19:1069 excites
- L21:217 excites
- L19:1479 suppresses
- L18:2222 suppresses
- L19:1106 suppresses
- L20:338 suppresses
- L19:732 suppresses unclear: end of document token
- L21:466 excites
- L18:1113 suppresses
- L17:1568 excites
- L15:2070 suppresses
- L15:410 suppresses
- L17:644 suppresses
- L19:2591 suppresses
- L7:1466 weakly excites
- L20:515 weakly excites period right before a line break
- L17:1043 weakly excites
- L18:1148 weakly suppresses
- L19:789 weakly suppresses
- L17:1088 weakly excites
- L16:2583 weakly suppresses
- L21:396 weakly suppresses
Feeds later layers
- L26:156 strongly excites
- L24:96 strongly suppresses
- L24:303 strongly excites
- L25:207 strongly excites
- L26:133 strongly excites
- L27:179 strongly suppresses
- L26:1180 strongly excites
- L25:1274 strongly excites
- L26:288 strongly excites
- L26:640 strongly suppresses
- L23:194 strongly suppresses
- L27:256 strongly suppresses
- L26:16 strongly suppresses
- L27:1065 strongly excites
- L27:309 strongly excites
- L25:144 strongly suppresses
- L27:445 excites
- L27:136 excites
- L26:2289 suppresses
- L24:2894 excites
- L26:749 excites
- L27:207 excites
- L26:230 excites
- L27:1053 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ',⏎⏎
- ,⏎⏎
- ",⏎⏎
- 、⏎⏎
- ,⏎⏎
- (),⏎⏎
- ),⏎⏎
- ],⏎⏎
- \⏎⏎
- },⏎⏎
Suppresses
- ?⏎
- .⏎
- ...⏎
- !⏎
- ...⏎
- …⏎
- 。⏎
- ?⏎
- ....⏎
- ?⏎