'in' after a noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'in' when it follows a noun and introduces a place or setting, such as 'water in a bottle' or 'solar systems in the United States'. Turning it down made the model keep repeating the word 'water'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
chucked in the bin and head straight for our landfill.⏎There are lots of products you can switch to:⏎- Instead of bottled water, change for tap water in a water bottle⏎- Swap your hair washing products for shampoo and conditioner bars⏎
-
of the global average, and nearly 700 million of its citizens live in regions considered highly water-stressed. Meanwhile, groundwater depletion has been so significant in the areas around Beijing that parts of the city are falling into the earth by more
-
Rep⏎Authors: Altman EA, Lee KL, Hecht CA, Hampton KE, Moreno G, Patel AI⏎Examining Policies Providing Access to Free Water in Schools and the Health Impact of an Alternative to Sugar-Sweetened BeveragesThis
-
is clean, with water or carbon dioxide being the only by-product.⏎While high capital costs have been an impediment to the use of fuel cells to power homes in the United States, several businesses use stationary fuel cell systems at operational facilities. As
-
can reach such aims. UN-Habitat works to increase global energy access with special emphasis on women and girls and to spread renewable energy technologies to enhance energy supply in urban areas. We particularly support conceptual and analytical awareness and understanding on gender, poverty
-
perceptible spurt in crop productivity, which has, of late, tended to stagnate at many places.⏎The saving on water, which is rapidly turning scarce in most paddy-growing tracts, can be 30 to 40
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: water is water, water is water, water is water. In the water water water water water water water water water water water water... water water water water... water water water water... water water water water... water water water water... water
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
options contract has the following properties or attributes:⏎- Expiration Date⏎- Symbol or Underlying⏎- Strike Price⏎- Type: Call or Put⏎The contract has
-
each leg measures about 23 inches. Males are typically slightly larger than females. Both sexes have gills that give the crabs the ability to breathe under water via gas exchange facilitated by the under-body set of small legs.⏎Breeding
-
some rights in exchange. This payment is called the premium. There are a few other important properties of this contract that will be explained here: Expiration Date, Underlying, Strike Price, option type: PUT or CALL⏎An
-
make that centuries now.⏎It’s true that salt water is a better conductor than fresh water but both environments need anode protection for boats that have any metal parts under water. Fresh water has sufficient impurities that it too conducts electricity, and therefore
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1935 suppresses
- L16:1807 suppresses 'in' after a motion verb
- L8:351 suppresses 'in' after 'high' or 'dressed'
- L4:289 excites
- L20:1574 excites
- L5:490 excites
- L17:706 excites
- L16:2259 weakly excites
- L10:525 weakly suppresses
- L17:3014 weakly suppresses
- L4:2603 weakly suppresses
- L9:1025 weakly excites
- L21:2644 weakly suppresses
- L10:132 weakly excites
- L14:1625 weakly excites the word 'in' after a noun
- L18:483 weakly excites
- L16:1557 weakly excites 'in' meaning 'in this case' or 'in between'
- L5:729 weakly suppresses
- L16:1913 weakly excites
- L19:1354 weakly excites
- L3:862 weakly suppresses
- L18:3057 weakly suppresses
- L4:1966 weakly suppresses
- L4:1240 weakly excites
Feeds later layers
- L27:2466 weakly suppresses
- L25:2356 weakly suppresses
- L24:1366 weakly excites
- L24:659 weakly suppresses
- L24:1989 weakly excites
- L24:708 weakly suppresses
- L25:3030 weakly suppresses 'Sub' starting a word or name
- L25:780 weakly excites opening parenthesis before an acronym
- L26:515 weakly suppresses
- L24:2374 weakly suppresses
- L27:1023 weakly excites
- L26:2281 weakly excites
- L26:2255 weakly suppresses
- L24:1457 weakly excites
- L26:2006 weakly suppresses
- L24:2961 weakly suppresses
- L26:2038 weakly suppresses
- L24:239 weakly excites
- L27:1922 weakly suppresses
- L27:630 weakly suppresses
- L27:1916 weakly suppresses capital P starting a word
- L24:3043 weakly suppresses
- L24:1365 weakly suppresses
- L26:1800 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- bas
- @⏎
- .Sleep
- 山村
- 又能
- ');");⏎
- asket
- remote
- ↾
- (provider
Suppresses
- water
- Water
- water
- 水
- воды
- água
- Water
- _water
- WATER
- agua