the after a verb or preposition
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "the" when it comes right after a verb or preposition, at the point where a noun phrase is about to start. It is weaker, or turns negative, on "the" after "to" in some sentences. Steering did not produce a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
bills live and thrive mainly in the conifer forests of the far northern U.S. as well as Canada. They also eat insects, fir seeds, and the occasional bud from a deciduous tree.⏎White-winged Crossbills are nom
-
provides information of a general nature and is designed for educational purposes only. If you have any concerns about your own health or the health of your child, you should always consult with a physician or other health care
-
to the controversial history of the hawthorn tree. In this comprehensive directory, you'll find garden plants organised according to type with hands-on advice for identifying the mystery interlopers in your borders, and information about their height, spread,
-
store. Click here now to check it out.⏎For example, let’s pretend you’re running an online store selling custom designed T-shirts. Your expenses would include the cost of creating, storing, and shipping the T-shirts to your customers. It
-
255 files?⏎File type specification:⏎The 255 file extension is associated with the Gimp (also known as GNU Image Manipulation Program), a picture image editing
-
noise, consider this: 44% of carpenters and 48% of plumbers report some hearing loss. Other noisy lines of work include the military, mining, manufacturing, agriculture, and transportation.⏎Even musicians, who literally
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: my small farm, my garden, and my garden, I know I have my garden and my garden, my gardeners and gardeners, the heart of a garden, my soil, I root my garden in the soil, my soil,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
near the differential, but most brakes today are located inside the wheels. (An inboard location reduces the unsprung weight and eliminates a source of heat transfer to the tires, important in Formula One racing.)⏎Disc brakes were most popular on sports cars
-
you exercise, periodically:⏎• Take your pulse on the inside of your wrist, on the thumb side.⏎• Use the tips of your first two fingers (not your thumb) to press lightly over the blood vessels on your wrist
-
services.<|endoftext|>The liver is an important body organ and power house of the body. It filters and processes your food. It filters your blood and passes it to the rest of the body part. The primary function of the liver is blood detoxification
-
Your Eyes⏎Often the summer heat means fatigue and tired eyes. You must refrain from rubbing your eyes, as most eye infections are fomite-borne, that is, spread
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:24 excites "the" before a named organisation or title
- L12:2554 suppresses
- L10:1377 suppresses
- L4:52 excites
- L10:120 suppresses
- L11:875 suppresses
- L11:331 excites
- L6:443 suppresses
- L11:1168 weakly excites
- L8:303 weakly excites
- L6:61 weakly suppresses
- L8:636 weakly suppresses
- L9:662 weakly suppresses
- L0:26 weakly suppresses
- L1:2477 weakly suppresses
- L1:59 weakly excites 'the' after a verb or preposition
- L2:1394 weakly suppresses
- L11:2469 weakly suppresses
- L10:29 weakly suppresses
- L9:1811 weakly excites
- L10:2566 weakly suppresses
- L3:291 weakly excites
- L12:162 weakly excites
- L4:740 weakly suppresses
Feeds later layers
- L17:1240 excites
- L14:1015 excites
- L19:582 weakly excites
- L20:251 weakly excites
- L15:1985 weakly excites
- L18:1945 weakly suppresses
- L14:739 weakly suppresses 'the' or 'your' before a body part or place
- L24:56 weakly excites
- L20:94 weakly suppresses
- L17:390 weakly excites
- L25:638 weakly excites
- L18:238 weakly suppresses
- L14:2965 weakly excites
- L17:353 weakly excites
- L15:482 weakly suppresses
- L17:146 weakly excites period after abbreviations and dates
- L21:596 weakly excites
- L15:1794 weakly excites
- L25:73 weakly excites
- L15:35 weakly suppresses
- L22:78 weakly suppresses
- L23:229 weakly excites
- L16:316 weakly suppresses
- L19:2410 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ures
- s
- rang
- ound
- imm
- illow
- 再去
- uration
- %%%%%%%%
- raz
Suppresses
- 나는
- expectedResult
- 不得转载
- 히
- iction
- vais
- ança
- :`~
- meisten
- ости