last digit of years like 1970
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the final zero in numbers like 1970, 1970s or 2500, especially years in the 1970s. Turning it up made the model's writing break into repetitive loops, so the steering text tells us little about it.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the overall picture of the conflict between two worlds, East and West, which determined the course of history.⏎Proving History is available online: https://2500years.culture.gov.gr/en.<|endoftext|>"Tell all the Truth"⏎Tell
-
thought.⏎The results are to be published in the journal Science.⏎The lower mantle comprises 55 percent of the planet by volume and extends from 670 and 2900 kilometers in depth, as defined by the so-called
-
umatic road tube traffic counter. Rubber hoses are stretched across a road and passing vehicles create air pulses that are recorded by a roadside counter. In 1970 the counts were mechanically recorded on a roll of paper tape. The time and number
-
are considered the progenitors of the modern Ukrainian nation and Ukrainian nationalist discourse appeals, to a large extent, to the Cossacks.⏎In 1670, the Don Cossack Stenka Razin proclaimed<|endoftext|>Amateur astronomers
-
landscapes beyond protected area networks.⏎“Remote sensing data from orbiting satellites have been used to measure, understand, and predict environmental changes since the 1970s, but technology that subsequently became available can now be applied much more widely on
-
create transition matrices of land cover change. Dates of acquired images represent the most cloud-free image retrievals from 1970-2001 for each site and are therefore not continuous. There are
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately. I have been thinking about lately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and%20adaptive%20immune%20system.⏎- How Vitamin C Supports a Healthy Immune Sysstem. Academy of Nutrition
-
be 99,800 unaffected pregnancies and 200 pregnancies with Down syndrome. The table below compares the
-
Mentor: Carl Ruetz⏎Page last modified July 14, 2009<|endoftext|>what does hamlet think about suicide? with textual support⏎2 Answers | Add Yours
-
called Wheel. If we consider the real-world, we can find many objects around us,<|endoftext|>18th Jan 12 14:01<< Go back to news⏎The kinetic force of braking can now be used in hybrid
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L1:82 suppresses
- L1:1458 suppresses
- L5:263 excites
- L3:230 suppresses
- L13:1160 suppresses
- L3:856 weakly suppresses
- L16:1220 weakly suppresses
- L15:199 weakly excites
- L8:2711 weakly suppresses
- L15:623 weakly excites
- L6:227 weakly suppresses
- L2:398 weakly suppresses
- L5:1219 weakly suppresses
- L1:2557 weakly suppresses
- L2:1774 weakly suppresses
- L3:282 weakly excites
- L1:1646 weakly suppresses
- L15:2065 weakly suppresses
- L25:2606 weakly suppresses
- L27:1343 weakly suppresses
- L16:2621 weakly suppresses
- L6:2970 weakly excites
- L25:2814 weakly suppresses
- L18:1308 weakly suppresses opening parenthesis before an acronym
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- hma
- 地中
- via
- 年后
- 禁
- th
- 送
- ustomer
- ana
- bj
Suppresses
- abble
- ITS
- endregion
- fection
- /owl
- ール
- 六大
- fections
- реш
- abouts