the gap before a decade or century
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small space between 'late' and a year or century that follows, as in 'the late 1930s' or 'the late 18th century'. It is a narrow, predictable trigger. Turning it up did not produce writing that clearly related to dates.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the late 1930s skiers have been trying to open up the San G
-
the late 18th century, with the mechanisation of the textile industry. Tasks previously
-
allando. Alphabet design became a subject of study, and several technical treatises were published on writing styles.⏎By the late 16th cent., with the secure establishment of the printing press, the art
-
Staircase-Escalante National Monument) to find out more about paleontology in that area.<|endoftext|>The principal systems of units used in scientific work, late 19th – early 20th centuries. In the United States,
-
imaging from space.⏎Rapid technological developments soon led to researchers receiving close-up views of the Moon and the inner planets. Within a few decades, by the late 1970s, planetary researchers were receiving thousands of colour images from Mars
-
ballad in four stanzas, as well as the melody for the ballad, appears in one of the key sources of English popular song of the late 17th and early 18th century called ‘Wit and M
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's the only thing that matters. This is a common approach of using the term "apple" to represent the solution. Now, I will have to be the most important. In the context of the term, let's say we are
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
system, and multithreading.⏎Also included is coverage of some of Java's most powerful features,⏎such as generics, lambda expressions, and the very important⏎modules feature. A number of recent
-
foundational features (such as data types, operators,⏎control statements, classes, and interfaces) to its advanced topics⏎(such as multithreading, annotations, generics, lambda expressions,⏎and modules). Of course, recent
-
Act implementation; (2) assess changes in the proportion of schools with excellent water access and barriers and facilitators to More<|endoftext|>Minnesota is a disclose in the Upper Midwest,
-
becoming constant. It may also become more severe when coughing, sneezing, or moving around. The pain may eventually radiate to the lower right side of the abdomen, where the appendix is located.⏎Loss of Appetite⏎One sign
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1385 suppresses
- L0:1224 suppresses
- L0:329 suppresses the digit 1 in years
- L3:50 weakly excites
- L0:178 weakly suppresses
- L3:115 weakly suppresses
- L3:59 weakly excites
- L3:122 weakly excites
- L1:1698 weakly suppresses
- L0:1839 weakly suppresses
- L2:1657 weakly excites
- L3:2998 weakly suppresses
- L3:464 weakly excites
- L0:1301 weakly suppresses
- L3:2042 weakly excites
- L0:2751 weakly suppresses
- L3:1484 weakly excites
- L3:1252 weakly excites
- L2:1494 weakly suppresses
- L1:1142 weakly suppresses
- L2:75 weakly suppresses
- L1:1999 weakly excites
- L0:407 weakly suppresses
- L1:2071 weakly suppresses
Feeds later layers
- L5:659 suppresses
- L5:788 excites
- L8:1478 suppresses
- L5:1656 excites 'of' after end, top or bottom
- L5:3024 suppresses
- L6:890 excites
- L7:558 weakly suppresses
- L12:2853 weakly excites
- L14:2658 weakly suppresses
- L7:2088 weakly excites
- L7:1941 weakly excites
- L12:272 weakly excites
- L5:1342 weakly suppresses
- L19:2872 weakly excites
- L25:1985 weakly suppresses
- L22:546 weakly excites
- L6:1167 weakly excites
- L18:2756 weakly suppresses
- L20:299 weakly suppresses
- L25:539 weakly suppresses
- L8:485 weakly suppresses
- L11:859 weakly excites
- L22:1248 weakly excites
- L22:2027 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- erin
- ่าน
- 령
- olson
- erdem
- -domain
- buch
- eri
- rencontre
- abeth
Suppresses
- minor
- T
- cha
- �回
- minor
- ños
- 每次
- GRA
- �试
- *