the 9 in years like 19xx
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the middle digit of years from the 1900s, such as the 9 in 1998 or 1993, when the number appears inside a citation or a date. Its most negative moments are on the start of the word 'statue', which is a different pattern. Turning it up or down changed the text in ways that did not match the pattern, so the steering results tell us little.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
who are expected to convey these values to learners formally through the implementation of values education. The concept of values education will be explained below.⏎Robb (1998) defines values education as an activity whereby people are educated about aspects that determine
-
out landmark studies on the natural history of cervical cancer that firmly established HPV as the necessary cause of this malignancy (Schiffman et al., 1993, 2007). Their efforts laid the groundwork for vaccine development
-
National Medal of Science (1986); the APA’s Award for Outstanding Lifetime Contributions to Psychology (1993)⏎- ACM fellow (1994)⏎- IJCAI Award for Research Excellence (1995
-
ivian Army and the CIA in 1967 (Castaneda 1998, 326).⏎What Individuals Thought of Che Guevara⏎
-
persuasiveness of viral campaigns in social network sites: Persuasive intent as the underlying mechanism. Journal of Marketing, 18(1), 39-53. http://dx.doi.org/10.10
-
the Society for American Baseball Research.⏎Jerry Malloy (1946-2000) was a pioneer researcher who was honored in 1997 by the creation of an annual Negro League Conference named for him. He was
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 48-cm (about 18-inch) machine with a 300-meter wave machine that is in a state of "re-connection." I have had a lot of learning and growth from this
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Manila. The bridge was rebuilt in spartan steel and concrete. None of the statuary of mermen on dolphin and allegorical sculptures are present in today’s Jones
-
. In June 47 B.C., Cleopatra bore a son, whom she claimed was Caesar's and named Caesarion, meaning "little<|endoftext|>The statuette is representing a Nubian kneeling pharaoh making an offering to the
-
of essential liturgical equipment of a sanctuary of Egypt or Nubia.⏎Solid copper alloy statuette formely clad with in precious-metal leaf.⏎On his pleated k
-
the entire state of Delaware. The iceberg goes to the depth of 600 and 700 feet below the sea which would mean stacking up two Statues of Liberty one over another.⏎The humungous piece of ice floating in
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1628 strongly excites
- L17:166 strongly excites
- L16:43 excites
- L18:541 excites
- L1:177 suppresses
- L2:1611 suppresses
- L0:1816 excites
- L18:1104 suppresses
- L5:204 excites
- L19:183 excites
- L10:233 suppresses
- L18:440 suppresses
- L7:287 excites
- L18:2397 excites 'followed' and 'searched' after a subject
- L2:2497 excites
- L16:673 excites
- L10:951 suppresses
- L1:5 suppresses
- L16:76 excites
- L18:569 excites
- L10:722 suppresses
- L19:381 suppresses word-start 'acc' fragments
- L16:30 suppresses
- L2:1585 excites
Feeds later layers
- L21:334 strongly suppresses
- L26:674 suppresses
- L23:2702 suppresses
- L24:2482 suppresses
- L23:2397 suppresses
- L22:1598 excites
- L27:2265 weakly suppresses
- L27:2553 weakly excites capital T starting a word
- L23:2608 weakly suppresses
- L24:2452 weakly suppresses
- L23:2940 weakly suppresses
- L21:1793 weakly excites
- L27:2187 weakly suppresses
- L25:2249 weakly suppresses
- L25:1669 weakly suppresses
- L21:2731 weakly excites
- L25:2234 weakly suppresses
- L26:2435 weakly excites
- L27:1863 weakly excites
- L23:2169 weakly excites
- L22:975 weakly excites
- L21:2887 weakly suppresses
- L27:824 weakly excites
- L21:271 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- station
- Goes
- go
- 两点
- ual
- (lower
- 脂肪
- ACHI
- /title
- pecial
Suppresses
- quo
- ards
- hread
- Trinity
- ycz
- onet
- essenger
- шие
- (optimizer
- roid