capital F starting a word
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to a capital F that begins a word or heading, like 'Fishing', 'Feminist', or 'Ferrets', especially where the word is split off from the text before it. Turning it up or down gave text with no clear link to that letter, so the effect on writing is hard to read.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
teachers to introduce children to the enchantment and magicality found in words. Highly recommended. 5 Stars. First reviewed for Readers Favorite.⏎by Fiona Ingram<|endoftext|>Fishing is both an art and a science. It is an art because it requires
-
life trajectories, goals, and challenges; attentiveness to social, institutional, and individual power structures and their relationships to privilege,⏎What is Feminist Family Therapy?⏎Feminist Family Therapy offers case-based discussions that address race, gender, and class
-
play an important role in the Israel-Palestine conflict, Freedland suggests examining the role Irish Americans had in helping to settle the conflict in Northern Ireland.⏎Freedland writes, the role of the Irish-American diaspora in the Northern Ireland
-
consort of Castile and León|⏎|Spouse||Alfonso X of Castile|⏎|Beatrice, Marchioness of Montferrat⏎Ferdinand de la Cerda⏎Sancho IV of Castile⏎|Father
-
asonic transmitters in French Polynesia between 1985 and 1997. Nine fish were caught near Fish Aggregating Devices (FADs) while the other two were tracked in coastal areas without FADs
-
ne, José Naranjo, Veterinary Doctor and international consultant in Animal Health and Public Health, provided an interesting analysis of the impact of foot-and-mouth disease (FMD) on countries’ production and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the whole middle part wasn’t part of the whole whole part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part part
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ptomatically.⏎-Please note this is not a medical mask and should not be worn as personal protective equipment.⏎-The face covering does not guarantee safety or protection.⏎-Face coverings should not be used as a replacement for social distancing or self isolation
-
40|⏎|Monday||May 01||Labour Day||Youm-e-Mazdoor|⏎|Monday||June 26||Eid-ul-Fitr||The end of Ramadan|⏎|Tuesday||June 27||E
-
The Value of Everything: Making and Taking in the Global Economy by Mariana Mazzucato. Copyright © 2018. Available from PublicAffairs, an imprint of Perseus Books, LLC, a subsidiary of H
-
January 8, by nadmin. Seminar for AAC – Cleveland This distrust is transferred to every person the adoptee wants to get close to. Self-blame/failure/low self-esteem Sadness/depression: loss . In Building Self-E
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:369 excites
- L23:2441 excites
- L18:437 excites
- L20:211 excites
- L17:378 excites
- L0:755 suppresses
- L18:328 suppresses
- L2:1622 excites
- L26:1042 suppresses
- L7:300 excites
- L17:253 weakly suppresses
- L19:1147 weakly suppresses
- L22:961 weakly suppresses
- L21:2605 weakly excites
- L1:9 weakly excites
- L16:47 weakly excites
- L0:1365 weakly suppresses
- L9:449 weakly suppresses
- L16:67 weakly excites
- L17:543 weakly suppresses
- L4:1892 weakly excites
- L16:11 weakly suppresses
- L19:702 weakly excites
- L7:49 weakly suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ways
- choice
- choix
- spur
- cause
- 引起
- unders
- 见效
- cause
- 琵
Suppresses
- plits
- orce
- orea
- rather
- un
- powstał
- ptides
- eel
- Bloody
- corner