prepositions after passive verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on small connecting words like 'by', 'through', 'from' and 'with' that come right after a verb or noun and introduce how something happens, such as 'enabled by', 'improved through' or 'transmitted by the bite of'. When turned up, the model's text got loose and wandering, without a clear shift.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
sometimes travel towards Earth where they are captured by the Earth’s magnetic field and guided towards the geomagnetic polar regions. On their way down these particles are slowed down by Earth’s atmosphere, which acts as a shield. These charged particles collide with gas
-
scientists are working with EMBL's spin<|endoftext|>Babesiosis is caused by parasites of the genus babesia, which are transmitted in nature by the bite of
-
Ways Remote Sensing Can Contribute to Conservation,” featured in the latest edition of the scientific journal Conservation Biology.⏎Addressing global questions requires global datasets that are enabled by satellite remote sensing; this paper highlights the way in which continuous observations of the
-
ichia coli (E. coli), and against Streptococcus canis, which can be passed from companion animals to humans.⏎What diseases can you get from dog saliva?⏎This review focused on the most important viral and bacterial zoonotic
-
.⏎Combinations And Pure Substances⏎<|endoftext|>Pricing in the sky⏎Many policy problems (from road congestion to water and electricity shortages) can be greatly improved through the proper application of a simple concept–pricing. In this USA Today article,
-
of stored honey during the winter months, which helps the bees produce body heat. Heat energy is produced by the oxidation of the honey, and circulated throughout the hive by the wing-fanning of worker bees . Note the diagram at right.⏎On warmer
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what to do to avoid to avoid to not to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Rebinding an Old Book Tutorial⏎Got an old book that has its pages coming apart and its stitches loosening up? Well, take out your supplies, and follow the rebinding process in this chapter.⏎Inspect your book; whether it is a
-
elerate the spread of the virus is being well informed about the coronavirus. This means that people should be well informed about the disease-causing virus and the ways through which it spreads the disease. The only easy and effective way to protect yourself from
-
Sikh Gurus) and 'Dwara (ਦੁਆਰਾ)' (gateway in Gurmukhi), together meaning 'the gateway through which the Guru could be reached'. Thereafter, all Sikh places of worship came
-
the subject isn't proof that they Achilles and Patrokles were anything other than heroic friends, models of what love looked like between warriors who faced death and depended on each other implicitly for survival. For me, the silence means they were exactly as
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:3004 suppresses
- L12:1040 suppresses
- L14:2512 suppresses
- L12:2685 excites
- L12:1733 excites
- L14:1953 suppresses
- L14:709 excites
- L9:1465 excites
- L14:2180 excites
- L6:2880 suppresses
- L9:2390 excites
- L14:2972 excites
- L12:1088 excites
- L4:1219 suppresses
- L6:1857 excites "until" after a negated clause
- L10:1242 excites
- L6:1956 suppresses "for" introducing a purpose or source
- L6:1726 suppresses
- L14:2416 suppresses
- L11:1267 excites
- L14:2044 suppresses
- L13:1228 excites
- L13:2366 suppresses
- L9:1340 suppresses
Feeds later layers
- L16:1267 excites
- L18:2911 excites
- L16:702 suppresses
- L16:1458 suppresses
- L16:1717 suppresses
- L16:1516 suppresses
- L19:597 excites
- L16:2157 excites
- L18:1502 excites
- L18:1509 suppresses
- L18:2903 suppresses
- L16:1216 suppresses
- L18:658 excites
- L17:484 excites
- L16:1948 excites
- L16:789 suppresses
- L16:2673 suppresses
- L18:290 suppresses
- L16:616 excites
- L17:863 excites
- L17:1241 excites
- L17:2840 excites
- L17:1957 suppresses
- L16:1531 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- express
- yp
- yal
- Express
- maté
- 一种
- 秀
- esk
- adies
- ayed
Suppresses
- NSS
- IGO
- OLS
- 谗
- NSE
- NEL
- ursed
- NSS
- ursal
- ventions