'in' after a past participle
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word 'in' when it follows a verb or noun and introduces a place or time, like 'built in 1245' or 'found in their hundreds'. The snippets are fairly consistent, but turning the neuron up or down did not make the writing change in a recognisable way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
8-year veteran of Louisiana coastal surveys, and Steve Gill, senior scientist at the agency’s Center for Operational Oceanographic Products and Services, spelled out the grim reality in interviews with The Lens. When new data on the rate of coastal subsidence is
-
-speed winds buffeted them about.⏎“Absolutely impossible,” declared Per Lindstrand, a Swedish aeronautical engineer and perhaps the world’s best-known balloonist, in an early Wired article about the project. “Just talk to anybody in the scientific
-
a millennium, but because in addition to the weapons and the precious gold jewelry, the raw materials for making bronze (tin and copper ingots) were also found in their hundreds. According to researchers from Oxford University, the implications of this is that
-
the first recorded use of the term occurred in 1712. The abbey’s best wines were set aside to be stored in a special cellar built in 1245, and it was later
-
views. You can make each one a block then place them one after the other down the page. Consider a shop.⏎A shop might list the top selling product in each category with a view sorted by category. The marketing manager then asks for the
-
larger opening to maximize light at night.⏎Schmitz and Motani measured the inner and outer dimensions of this ring, plus the size of the eye socket, in 33 fossils of dinosaurs, ancestral birds and pterosaurs. They also
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: *This is a lot of life, a lot of work, and a lot of ***life* *** *life is a lot of life, a lot of work, a lot of ***life* *** *life *
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
One student can change the chemistry of whole class. How do you bring balance to the Force in your class?⏎Here’s my response:⏎A sad truism about classroom dynamics is that it is far easier for one negative
-
dont have all the answers. Young children, in particular, seem to expect parents to be all knowing - even about death. But death, the one certainty in all life, if lifes greatest uncertainty. Coming to terms with death can be a lifelong
-
world from that different angle at an early age so that they want to explore and engage with a variety of topics and ideas.⏎There are three simple things we do in our home to inspire creativity
-
2021 enumeration.⏎Though the Government of India had decided on the policy of official discouragement of caste, no one can deny that caste is a reality in India. In order to compensate the birth based discriminations and the centuries ridden social
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:706 excites
- L16:1807 suppresses 'in' after a motion verb
- L14:2458 suppresses
- L19:1986 excites 'into' after a verb or 'well'
- L18:2266 suppresses
- L19:2731 weakly suppresses
- L19:1881 weakly suppresses
- L12:1169 weakly excites
- L15:2361 weakly excites
- L4:4 weakly suppresses
- L11:2497 weakly suppresses
- L0:2759 weakly excites
- L18:1588 weakly excites
- L19:2371 weakly excites
- L13:1320 weakly suppresses
- L16:2155 weakly suppresses
- L18:2321 weakly suppresses
- L8:3068 weakly suppresses
- L12:1904 weakly suppresses
- L6:131 weakly suppresses
- L16:1557 weakly excites 'in' meaning 'in this case' or 'in between'
- L17:2954 weakly excites
- L14:1857 weakly excites
- L16:2180 weakly excites
Feeds later layers
- L21:1169 excites
- L21:2397 weakly suppresses
- L22:1672 weakly suppresses
- L21:2944 weakly suppresses
- L23:1389 weakly suppresses
- L25:125 weakly suppresses
- L26:2919 weakly excites
- L21:942 weakly suppresses
- L23:1273 weakly excites
- L22:2433 weakly suppresses
- L24:691 weakly suppresses
- L27:1087 weakly excites
- L27:524 weakly excites
- L23:353 weakly suppresses
- L27:3017 weakly excites
- L22:1706 weakly suppresses
- L27:1779 weakly excites
- L21:1574 weakly suppresses
- L24:1174 weakly suppresses
- L26:2442 weakly excites
- L26:717 weakly excites
- L26:927 weakly suppresses
- L27:536 weakly suppresses
- L24:690 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- pite
- parted
- ecome
- ILINE
- CALE
- 在哪里
- LIABLE
- result
- 魂
- (raw
Suppresses
- medicine
- *d
- 澍
- ーション
- 书面
- иж
- 企
- _pointer
- Croatia
- writing