'the' inside organisation and convention names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'the' when it sits inside the name of an organisation, treaty or event, such as 'Society for the Scientific Study of Reading' or 'Convention on the Rights of the Child'. Turning it up or down did not give a clear theme in the written text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
). Effectiveness of a tiered intervention model in Chinese: A growth model of reading fluency. Paper presented at the Twenty-First Annual Meeting: Society for the Scientific Study of Reading, Santa Fe, New Maxico.⏎- Response to intervention
-
it appears that school resources, student academic ability, and students learning in their mother tongue are some factors for consideration. Copyright © 2014 Society for the Scientific Study of Reading (SSSR).⏎|Publication status||Published - Jul
-
assessed.⏎In the seminar "Practical Evaluation of Measurement Uncertainty", you learn how to consistently and reproducibly evaluate measurement uncertainty according to the ISO Guide to the Expression of Uncertainty in Measurement (GUM), which is also known as the
-
environment that is conducive to providing speech intelligibility, speech privacy, low distractions and annoyance, and sound quality.⏎And, according to ongoing research at the Center for the Built Environment (CBE), it is the lowest performing IEQ factor in green
-
actual or foreseeable threats to this right, including in the context of gun violence.⏎The U.S. signed the Convention on the Rights of the Child in 1995. This means that the U
-
in traditionally ‘female’ industries and occupations could be equally recognised in terms of the value of its contribution. ⏎After much public debate, Australia ratified the Convention on the Elimination of All Forms of Discrimination Against Women (CEDAW), which was
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: A SierA SierA SierA SierA SierA SierA SierA SierA SierA SierA SierA SierA
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
), NASA, and other organizations have partnered to focus global attention on the contribution of satellites to biodiversity conservation in a recently released study entitled “Ten Ways Remote Sensing Can Contribute to Conservation,” featured in the latest edition of the scientific journal Conservation Biology
-
sexual intercourse. During this time, you will also lose interest in sexual activity. However, this may also be due to dehydration or less intake of water.⏎Loss of Sexual Desires⏎A woman who has reached menopause will engage in lesser sexual
-
things you need to know before starting. Keep reading to learn more about how long composting takes and what you need to get started!⏎How Long Does It Take To Break Compost Down?⏎This is a difficult question to answer because it depends on
-
you from carrying out your daily activities. Some of the symptoms you may experience include:⏎- Sleep problems⏎- Hot flashes⏎- Vaginal dryness⏎- Thinning of hair⏎- Sleeping difficulties⏎- Bone loss⏎- Mood swings
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1455 strongly suppresses
- L20:351 strongly excites
- L19:484 strongly excites
- L20:1111 strongly suppresses
- L19:474 strongly excites
- L20:343 strongly excites
- L19:1485 strongly suppresses
- L20:308 strongly excites
- L21:185 strongly suppresses
- L19:1941 strongly excites
- L19:2730 strongly suppresses
- L18:2824 strongly suppresses
- L23:278 strongly excites
- L19:96 strongly excites
- L21:605 strongly suppresses
- L21:370 strongly excites
- L21:335 strongly suppresses
- L22:1829 strongly excites
- L22:430 strongly excites
- L21:846 strongly excites
- L23:528 strongly suppresses
- L20:1002 strongly suppresses
- L15:1565 strongly suppresses
- L16:1982 excites
Feeds later layers
- L25:67 strongly suppresses
- L27:16 strongly suppresses
- L27:12 strongly suppresses
- L27:91 strongly suppresses
- L26:231 strongly suppresses
- L26:161 strongly suppresses
- L27:715 strongly suppresses
- L27:818 strongly suppresses inside names of journals and institutions
- L27:535 strongly suppresses
- L26:630 strongly suppresses
- L27:371 strongly suppresses
- L27:459 strongly suppresses
- L27:664 strongly suppresses
- L26:960 strongly suppresses
- L26:299 strongly suppresses
- L27:543 strongly suppresses
- L25:594 strongly suppresses
- L27:805 strongly suppresses
- L27:377 suppresses
- L27:507 suppresses
- L27:411 suppresses
- L27:199 suppresses
- L26:448 suppresses
- L27:133 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- dragon
- wolf
- _this
- ucken
- _since
- もらえ
- ですか
- adidas
- otland
- URING
Suppresses
- Con
- Plane
- Res
- Cur
- Com
- Memory
- Vari
- Tr
- Hist
- Ext