"of" after amounts of land
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "of" when it comes right after an amount of land, like "acres of" or "tract of", and the next word is likely to be "land". When it was turned up, the model kept saying "land" over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
1878, as the Missouri, Kansas and Texas Railroad was making its way into the state, New York investor William Whitewright purchased a tract of land in the railroad’s right-of-way. He surveyed a town site and then
-
⏎In Early 2015, the founder and director of Borderlands Restoration were presented with a unique opportunity; over 1,000 acres of nearly pristine grassland,
-
the mouth of the Little Miami. Early entrepreneurs Israel Ludlow, Matthias Denman, and Robert Patterson purchased from John Cleves Symmes 800 acres of land and created the second settlement opposite the mouth of the Licking River. The
-
counter to the predominant belief that high-yield farming is bad for the planet.⏎Typically, the practice of squeezing out as much food as possible from a parcel of land is associated with over-application of fertilizers and pesticides, extensive soil erosion,
-
all wildlife encountered on the trail<|endoftext|>In 1847, when Mormon pioneers arrived in the Salt Lake Valley, LDS Church president Brigham Young selected a plot of the desert ground and
-
forest protection by buying tracts of land, but which often fail to address the needs or rights of local Indigenous peoples
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the value of a driver's position in a driver's own position in the middle of the vehicle's *position* from the vehicle's *position* from the *position* from the *position* from the *position* from the *
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
image above, the TA is a thick layer of muscle. The transverse abdominal muscle wraps around the torso from front to back and the muscle fibers of the TA run horizontally, similar to a corset
-
Exercises To Help You Avoid Injury⏎Well + Good reports on iliotibial band syndrome (ITBS), the most common overuse injury of the tendon that runs from the outside part of the hip across the hip and the knee joints.⏎Well
-
?⏎The spine runs down the middle of the back. A healthy spinal cord is completely straight with all
-
4. Today, state-of-the-art, innovative technologies are still based on discoveries made by researchers nearly<|endoftext|>The material in fridge magnets is magnetised in strips that run the length of the material, forming a Halbach Array. The result of this
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:825 suppresses 'B' in vitamin B names
- L15:2975 suppresses
- L7:204 excites
- L16:2287 suppresses
- L5:2150 suppresses
- L19:1904 suppresses
- L15:1535 weakly suppresses
- L20:1627 weakly excites
- L7:1149 weakly excites
- L15:1167 weakly suppresses
- L6:2003 weakly excites
- L4:1256 weakly excites
- L18:2108 weakly suppresses
- L6:2174 weakly excites
- L11:1127 weakly suppresses
- L11:2288 weakly excites
- L9:2837 weakly excites
- L6:1887 weakly suppresses
- L11:2806 weakly excites
- L20:402 weakly excites
- L14:1544 weakly suppresses
- L20:2637 weakly suppresses
- L20:1168 weakly excites
- L8:2745 weakly suppresses
Feeds later layers
- L23:1527 weakly suppresses
- L22:2843 weakly excites
- L23:1938 weakly excites
- L23:1144 weakly suppresses
- L25:2547 weakly excites
- L23:2885 weakly excites
- L23:2798 weakly suppresses
- L22:2724 weakly excites
- L22:2977 weakly suppresses
- L26:2661 weakly suppresses
- L22:3023 weakly suppresses
- L25:878 weakly suppresses
- L23:494 weakly excites
- L23:2011 weakly suppresses
- L23:1672 weakly excites
- L24:1386 weakly excites
- L22:2864 weakly suppresses
- L27:1359 weakly excites
- L22:1929 weakly excites "on" after "of all living things" phrases
- L22:626 weakly suppresses
- L23:3032 weakly suppresses hair and hair anatomy words
- L22:350 weakly suppresses
- L25:92 weakly excites
- L23:3049 weakly excites the 'hum' piece of words
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- land
- LAND
- lands
- land
- 土地
- Land
- Land
- 皮肤
- 空气
- carpet
Suppresses
- rido
- lla
- izr
- iddles
- bilt
- 針
- phis
- quir
- odb
- testim