the digit 9 inside numbers
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the digit 9 when it appears inside a number, such as a percentage, a phone number like 9-1-1, or a rate like 98%. Its negative side fires on the word email and its pieces, and turning it down pushed the model toward writing about email.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
⏎To use the formula, first figure out what you want your error of tolerance to be. For example, you may be happy with a confidence level of 95 percent (giving a margin error of 0.05), or
-
Overall, these tests have excellent detection rates (~99%) with very low false-positive rates (~0.2%). In other words, these tests are about 99.0% sensitive and 99.8% specific.⏎With performance
-
or discomfort, or a severe cough, contact your health care provider, walk-in clinic, or emergency department. If you are having a medical emergency, call 9-1-1.⏎Tips to reduce your smoke exposure⏎Smoke levels may be
-
world. All steels, including structural steels, are completely recyclable materials. Steel material has the highest rate in the market with a recycling rate of 98%. It always returns to the steelmaking facilities as scrap steel and it can
-
first-come, first-serve basis.⏎For information call 9<|endoftext|>The Parliamentary Commissioner for the Environment has announced:⏎Parliamentary Commissioner for the
-
spread through your bloodstream and cause life-threatening damage to your heart or kidneys. It can also cause nerve damage that leads to paralysis.⏎Call your local emergency number (911 in the US) if:⏎- You have severe trouble breathing.⏎Call
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 4-bit address address. I have a 4-bit address address. I have a 4-bit address address. I have a 4-bit address address. I have a 4-bit address address. I have a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
below. You may download and print the language guide for personal use.⏎Please note: this is not a static document and will evolve over time. Please email [email protected] or use our feedback form if there are other words you think
-
-Sheva, Israel⏎- *Corresponding Author:⏎- Yeongha Wook⏎Department of Pediatrics,⏎Soroka University Medical Center,⏎E-mail: [email protected]⏎Received: 01-Nov-2022
-
these relate to what we know today.⏎In association with STFC Rutherford Appleton Laboratory⏎If your child has additional needs, please get in touch on [email protected] to discuss how we can best support you.⏎For information on our booking
-
to do it too!⏎Winter Olympics | Pocantico Hills School⏎This page was last edited December 02, 2005.⏎e-mail us at:<|endoftext|>Courtesy ESA/Rosetta/MPS for OSIRIS Team
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:2675 suppresses
- L9:2112 excites
- L7:2039 suppresses
- L6:2602 suppresses
- L18:1104 suppresses
- L9:2017 suppresses
- L5:2534 excites
- L12:2751 suppresses
- L8:2782 suppresses
- L6:2013 excites
- L18:3020 weakly suppresses
- L8:1408 weakly suppresses
- L11:626 weakly excites
- L5:2409 weakly excites
- L6:2428 weakly excites
- L2:2099 weakly excites
- L11:1502 weakly excites
- L7:2461 weakly suppresses
- L15:2809 weakly suppresses
- L7:1542 weakly suppresses
- L6:1722 weakly suppresses
- L9:1772 weakly excites
- L5:3034 weakly excites
- L7:1430 weakly suppresses
Feeds later layers
- L23:1232 suppresses
- L23:3053 suppresses
- L27:2421 suppresses
- L22:2890 suppresses
- L24:1698 suppresses
- L27:1952 weakly suppresses
- L22:2622 weakly suppresses
- L21:2649 weakly excites
- L25:2586 weakly excites
- L26:1315 weakly suppresses
- L23:1885 weakly excites
- L20:454 weakly excites
- L20:2138 weakly excites
- L21:435 weakly suppresses
- L25:2588 weakly suppresses
- L25:1874 weakly suppresses
- L21:2847 weakly suppresses
- L21:1625 weakly excites
- L21:2186 weakly excites
- L23:1307 weakly suppresses
- L23:2793 weakly excites
- L21:2579 weakly suppresses
- L22:2860 weakly excites
- L24:3062 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 鳌
- erah
- vre
- рез
- roaring
- ре
- mpeg
- otics
- Nos
- ledon
Suppresses
- 邮件
- emails
- 邮箱
- getEmail
- 电子邮件
- Gmail