sports leagues and team names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on sports words, especially league and team names like NFL, NBA, Negro League and baseball. It turns off on soccer-style words like 'corner' and 'the goal'. Turning it up did not produce any sports text, so the link is only in the reading of text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
The Pressure to Perform⏎Chuck Knoblauch was an outstanding baseball player in the 1990s. He won Rookie of the Year” and multiple Gold Gloves (outstanding defense). Because of his excellence, he was offered a
-
in the black community. His namesake park boasts an aquatic complex and state-of-the-art sports facilities, with two solar trees near the well-equipped playground. Several NFL players, including Lavonte David of the Tampa Bay Buccaneers and Devonta Freeman of
-
14/08/18/out-at-home/⏎- Related link: Click here to view photos from the 17th annual Jerry Malloy Negro League Conference on August 14-16, 2014⏎
-
disciplined me has a great deal to do with the success I have enjoyed as a man,” Peterson said in a statement.⏎Among those coming to Peterson’s defense was NBA Hall of Famer Charles Barkley. On the CBS pregame show The NFL
-
enzel found that people tend to seek restorative justice rather than retributive justice when they perceive a shared identity with the offender. In the sense that National Football League fans, employees, and players share the “NFL family” identity, the
-
happened makes compelling reading; from “The National Pastime” of 1983, which I had created in the previous year for the Society for American Baseball Research.⏎Jerry Malloy (1946-2000)
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: If I had 6000 of the kind of power that can drive the economy, what would happen if we give more of that power out to the economy, and give the economy more control? If the economy is more powerful,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
will claim that a goal kick should be given and other will call for a corner.⏎Why does the kicker raise his hand?⏎Raising their hand acts as a
-
ank free throws off the back of the backboard. Quarterbacks throw passes that sail off into the air. Soccer players kick empty net goals over the top of the goal. All of these players seem to ‘forget’ how to do movements they
-
etc.⏎Why do soccer players raise their hands after a goal?⏎Players raise their hand to claim that their team should take the throw in. … In case of corner one team
-
the tournament for the first time as Dutch East Indies, now Indonesia, qualified while other Asian teams withdrew.⏎The tournament saw an average of 4.66 goals per match much to the delight of the spectators across the 10 host cities
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2469 strongly excites
- L21:1039 strongly suppresses
- L6:2728 suppresses
- L3:1552 excites
- L9:857 excites
- L8:2451 excites
- L3:877 suppresses
- L3:1202 excites
- L4:1812 suppresses
- L16:2303 suppresses
- L19:2619 weakly excites
- L3:2672 weakly suppresses
- L0:2525 weakly excites
- L14:175 weakly suppresses
- L8:1869 weakly suppresses
- L8:504 weakly excites
- L21:2155 weakly excites
- L14:2303 weakly suppresses
- L10:3043 weakly excites
- L7:1535 weakly suppresses
- L1:694 weakly excites
- L7:2335 weakly excites
- L20:1895 weakly excites
- L10:2350 weakly excites
Feeds later layers
- L23:1483 suppresses
- L23:2551 weakly suppresses baseball and sports mentions
- L25:2891 weakly suppresses
- L27:1546 weakly suppresses
- L23:2267 weakly suppresses
- L24:2314 weakly excites
- L27:1784 weakly excites
- L27:2772 weakly suppresses
- L25:2724 weakly suppresses
- L25:927 weakly suppresses
- L27:1249 weakly suppresses
- L25:129 weakly suppresses
- L25:3013 weakly suppresses
- L23:988 weakly suppresses
- L24:1608 weakly suppresses
- L27:1519 weakly suppresses
- L23:1031 weakly suppresses
- L24:2620 weakly excites
- L24:1939 weakly suppresses
- L23:987 weakly excites
- L26:1658 weakly suppresses
- L23:116 weakly suppresses
- L27:1766 weakly suppresses
- L23:93 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Co
- (co
- Co
- co
- co
- -co
- /co
- -Co
- _co
- .assign
Suppresses
- nets
- .openg
- net
- emie
- aris
- 威胁
- threat
- giveaways
- ******************************************************************************⏎
- *******************************************************************************/⏎