unclear: commas and 'or' in lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is weak and hard to pin down. Its strongest hits are commas and words like 'or' inside lists or clauses, but the pattern is not consistent. Turning it up did not produce a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
contact, while 40% reported experiencing verbal abuse.⏎The problem is not limited to female students, however. Male students also experience sexual harassment, although to a lesser extent. According to the same study, 20% of male university
-
foods that contain gluten. Gluten is a protein present in a certain number of cereals: wheat, rye, oats and barley. Foods containing these cereals or their derivatives,
-
same output.⏎- Nearly Every Database supports available⏎One of the greatest features in PHP is its support for a wide range of databases, nearly every databases – MySQL, ORACLE, PostgreSQL, Sybase, Informix to name a few.⏎What
-
umbled.⏎Walesa called for that persistence from his listeners. The message was only slightly different from his speech four years earlier at a College-sponsored event attended by, among others, local mayors and elected officials.⏎Things have been changing in Cuba
-
cted a description of liberty to justify it. The “devil,” in this case, lies not in the details but in the harm principle:⏎That principle is, that the sole end for which mankind are warranted, individually or collectively in interfering with
-
local Excessive Heat Warning criteria in the next 24 to 72 hours.⏎- Excessive Heat Warning⏎– Heat Index values are forecasting to meet or exceed locally defined warning criteria for at least 2 days (daytime highs=
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 43-year-old man who is a former partner in the past. The past 20 years have passed, and I have been a member of the organization, and I have been a member of the organization. I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
unda tamamlamıştır.⏎Yüksek Lisans Öğrenimine MSÜ Barbaros DEBİM Enstitüsünde devam etmekte aynı zamanda enerji sistem ve modelleme üzerine araştırmalar
-
permitted the right to gain literacy’ entrenched so deeply in people’s mindset that it resulted in a lacking of reliable narrative sources.⏎That Douglass was about to write drew public attention, put him under the limelight, and made him the only loud
-
Summer in North India is indeed hot and cruel, the long hot and often humid summer days, and the even more uncomfortable sultry, hot evenings in the capital leave us all dehydrated and exhausted. The heat, and the air conditioning,
-
the jet age and the information age. Geography is where any discussion of the strategic environment must begin. To know a country’s geography provides clues to its intentions better than any wiretap of its national security meetings. The geography that concerned us in the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:554 suppresses
- L6:335 suppresses
- L7:152 suppresses
- L4:153 suppresses
- L6:65 suppresses
- L5:433 suppresses
- L4:43 suppresses
- L6:145 excites
- L7:1582 suppresses
- L4:2955 excites
- L7:1584 suppresses
- L7:3018 suppresses
- L6:230 weakly suppresses
- L6:541 weakly suppresses
- L7:506 weakly excites
- L6:1648 weakly excites
- L6:393 weakly suppresses
- L4:735 weakly suppresses
- L7:223 weakly suppresses
- L7:69 weakly suppresses
- L3:853 weakly suppresses
- L4:91 weakly excites
- L3:73 weakly suppresses
- L7:362 weakly excites
Feeds later layers
- L10:319 excites
- L9:544 excites
- L12:1222 excites
- L9:1196 excites
- L9:680 excites
- L15:1746 excites
- L9:1143 excites
- L13:2988 excites
- L10:1781 excites
- L9:738 suppresses
- L11:2655 excites
- L11:775 excites
- L14:2088 excites
- L14:1920 excites
- L9:686 excites
- L11:1290 excites
- L9:1088 excites
- L13:76 suppresses
- L12:2513 excites
- L14:1227 excites
- L13:1385 excites
- L10:899 excites
- L10:756 excites
- L14:2204 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- otive
- Subtitle
- &,
- hs
- Solar
- cular
- lsi
- DUCTION
- efs
- hält
Suppresses
- ochen
- ivor
- _possible
- eren
- 权
- 所所长
- 所
- .prototype
- inator
- fce