unclear: parentheses and word fragments
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It fires on a mix of opening brackets before numbers and on the middle pieces of split words, such as the 'ated' in 'inaugurated'. Turning it up made the model produce repetitive or unrelated text.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ay, lists just over 1,500 names on 23 bronze plaques. It was erected in 1923, and inaugurated by the then landowner, Lord Leverhulme. The first memorial in
-
1 problem (12 points). Part B has 5 shorter problems (7 points each, so 35 points). Part C has 3 traditional problems (15 points each so 45 points). Total is 92 points
-
ology for hints that the Red Planet may have ever had conditions hospitable to life.⏎The startlingly clear photo, one of several new views released by NASA today (Aug. 8), shows Curiosity's heat shield after it was shed about
-
temperature for the year in Mount Surprise is 73.0°F (22.8°C). The warmest month, on average, is November with an average temperature of 81.0°F (27.2°C).
-
Mosquito Bite⏎|Duration Of The Events⏎|Symptoms of dengue⏎|Three to four days⏎|Recovery from dengue⏎|Ten to twelve days⏎After the mosquito bite, the person feels standard for a
-
even though the practice has been illegal for almost 40 years.⏎It is estimated more than four million of them are children.⏎The BBC's Humphrey Hawksley reports from the village of Pipalguda in the Indian state of Orissa.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first one, the one that is a little more than a mile from the Earth's surface, the one that is at latitude, north, south, or... the Earth's, at latitude 0, 90°,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
in the Ussr. StudyMode.com. Retrieved 05, 2012, from http://www.studymode.com/essays/The-Struggle-For-Power-In-The-99432
-
remote control for situations that the machine can’t quite do things,” he said.⏎For the rest of this article, click here: http://www.abc.net.au/news/rural/2017-05-23/the-f
-
European health officials reported 1,073 cases of measles from 15 countries in Jan. 2018. Greece and France reported the most cases with 431
-
miles. The cumulative estimate for the year is 2,972.3 billion vehicle miles.⏎Comparing year-over-year figures, the West showed the most growth at 3.2 percent, followed by the South Atlantic at 2
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:2934 strongly suppresses
- L12:408 suppresses
- L14:1435 excites
- L13:2915 suppresses
- L13:2125 suppresses
- L14:840 suppresses
- L13:2651 excites
- L13:2288 excites
- L14:258 excites
- L12:2797 excites
- L13:638 excites
- L14:241 suppresses
- L13:1740 excites
- L13:513 excites
- L12:2801 excites percentages and time spans in statistics
- L13:2748 suppresses
- L14:2939 excites
- L13:1710 excites
- L12:888 suppresses
- L14:1895 suppresses
- L12:2128 suppresses
- L13:1705 suppresses
- L10:1840 suppresses
- L14:1912 weakly suppresses document end, then unrelated text
Feeds later layers
- L16:2306 strongly suppresses
- L18:2739 suppresses
- L19:1481 suppresses
- L18:1501 suppresses
- L25:360 suppresses
- L16:431 excites
- L23:224 suppresses
- L16:2161 suppresses
- L20:758 suppresses
- L16:1680 suppresses
- L26:13 excites
- L26:234 suppresses
- L18:2014 suppresses
- L17:1878 suppresses
- L19:1947 suppresses
- L20:521 suppresses
- L19:1921 suppresses
- L27:218 suppresses
- L16:2759 suppresses
- L18:291 excites
- L19:1732 suppresses
- L16:508 suppresses
- L16:1165 weakly suppresses
- L20:947 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- .Reverse
- lest
- .Serial
- .SplitContainer
- VERIFY
- )::
- ental
- erin
- /design
- ircuit
Suppresses
- (
- (
- (-
- ($
- (
- ({
- ($_
- 授
- (**
- (.