number ranges like 0 to 9
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word or dash that links a starting number of zero to the end of a range, such as '0 to 9' or '0 and 1'. When it was turned up, the model's writing drifted into unrelated, repetitive text, so the effect on writing is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
William Wollaston, was first published in 1722. This text is based on Kessinger Publishing's facsimile (ISBN 0-7661-6894-8) of J. and
-
53 ± 0.49 (range; 0–8) lianas per tree. At PCWS, the trees with medium g
-
L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | 0-9⏎21 results for Schools: |⏎See previous results⏎See results
-
However, many of them are shocks with a small magnitude between 0 and 3.9. In 2011, japan experienced a devastating
-
7 segment display to your 8051 processor, in this example we will do this and show a code example which cycles through the numbers 0 to 9.⏎First of all a 7 segment display is basically a collection of
-
of special interest because to calculate the radiation from the earth’s surface we need to know only temperature and emissivity.⏎Emissivity is a value between 0 and 1. And is also depends on the wavelength of radiation (and in some
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: To be ________ A. If the action is to let the person do something that is the same as their body and the person's body, and they are just waiting to do it for all the people that are already here.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
used in 1974 .. to describe a global TCP/IP network. So, you could also argue the Internet (<|endoftext|>このトピックには0件の返信が含まれ、1人の参加者がいます。2020
-
, an endodontist does not want to immediately extract teeth. In fact, an endodontist
-
, astronomers say the newly-discovered brown dwarf is one of a pair in a double system 75 light-years from Earth. Astronomers describe the brown dwarfs, identified as CFBDSIR 1458+10
-
teeth, it is important to seek professional care from a specialist. A general dentist will not have the experience or tools to treat serious damage, where an endodontist does.⏎The type of issues an endodontist treats⏎While minor issues
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1079 weakly suppresses
- L4:2937 weakly excites
- L4:2006 weakly suppresses
- L0:2103 weakly suppresses
- L3:1226 weakly excites
- L1:208 weakly suppresses
- L1:2318 weakly suppresses
- L0:1520 weakly excites
- L1:2200 weakly excites
- L3:2885 weakly excites
- L2:670 weakly excites
- L3:1325 weakly suppresses
- L3:2270 weakly suppresses
- L3:220 weakly suppresses
- L4:2099 weakly excites
- L3:573 weakly excites
- L4:1851 weakly suppresses
- L4:2267 weakly suppresses
- L1:912 weakly excites
- L0:1070 weakly suppresses
- L1:221 weakly suppresses
- L0:1581 weakly excites
- L3:52 weakly suppresses
- L1:2463 weakly suppresses
Feeds later layers
- L7:1026 weakly excites
- L12:666 weakly excites
- L13:2610 weakly suppresses
- L12:921 weakly excites
- L13:1080 weakly excites
- L14:2355 weakly excites
- L24:178 weakly excites
- L14:2644 weakly excites page numbers in citations
- L11:500 weakly excites
- L19:578 weakly excites
- L18:2648 weakly suppresses
- L26:2275 weakly excites
- L19:1716 weakly excites
- L16:1027 weakly excites
- L19:1291 weakly suppresses
- L9:1853 weakly suppresses
- L12:1046 weakly excites
- L25:2259 weakly excites
- L6:2412 weakly suppresses
- L21:2637 weakly excites
- L15:2187 weakly excites
- L15:2275 weakly suppresses
- L8:1824 weakly excites
- L14:1129 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- mpp
- qv
- rq
- hq
- mares
- 辋
- prest
- の方
- 驹
- MRI
Suppresses
- 生意
- #/
- 牠
- enic
- universal
- 大家一起
- ogóle
- IFI
- Carbon
- culator