the word 'off' in phrases
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'off' in phrases like 'off the land', 'off track' or 'off chance', and goes quiet or dips on words like 'early' in time phrases. Turning it up or down did not make the model's writing about anything in particular.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
drawback of sawdust mushroom is, it’s not as nutritious for mushroom development as one might want. Accordingly, you might be frustrated with your yield on the off chance that you attempt to develop mushrooms from straight sawdust. Mushroom growing units
-
they’re competing with the farmers for land and farmers have made a lot of cattle grazing land. And as a result their natural resources such as wallabies are disappearing off the land and they’ve got to eat something. And so sheep are easy to
-
prints on a desktop printer and/or share your photos online.⏎A lot of online tutorials make it sound sort of scary, but it’s not. If you’re off a few (or 30) seconds or your water’s a couple degrees
-
in trainings and capacity development activities.<|endoftext|>One of the hardest things for a parent to do is to let their child go. And it’s not just going off to school or leaving the house after high school graduation. Once kids hit their teenage
-
the problem of hunger caused by poverty and insufficient production of food.⏎- one of the poorest countries in the world – in some of its regions, people live off less than 1.25 USD per day⏎- due to the food
-
how is it still living if it’s gone?⏎It was home to teachers, farmers, horsemen, and Kentucky civil rights leader Jesse Bottoms.⏎Located off US 60 and the Bluegrass Parkway, Huntertown was built after the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 200,000, 200, and 20, but I didn’t have the other one. I have a 5, 5 and 5, but I haven’t had
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Society’s 121st annual Christmas Bird Count.⏎Since 1900, an annual census of birds in the Western Hemisphere has been taken in early winter. It is conducted by volunteer birdwatchers in various areas or “count
-
survive these conditions. Watering deeply once a week, then periodically throughout can help ensure this. The best times to water your garden is early in the morning or early in the evening. You should not be watering your plants in direct sunlight.⏎If
-
It thrives in full sun but will tolerate part shade.⏎To get the highest yield of tender and flavorful leaves, pinch the tip of each branch, starting in early summer when the plants are 6" tall, to encourage bushiness. However
-
1971, six crews were identified and assigned to specific Soyuz spacecraft serial numbers for these tests. These would have been launched in three pairs beginning in early 1972, depending on the schedule for the DOS-2 station
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:943 suppresses
- L17:2228 excites
- L17:2969 excites
- L16:249 excites
- L4:2570 weakly suppresses
- L17:337 weakly suppresses
- L7:1440 weakly excites
- L16:428 weakly excites unclear: mid-sentence commas, 'most' before a verb
- L17:838 weakly suppresses
- L17:128 weakly suppresses
- L16:260 weakly excites
- L16:215 weakly suppresses
- L4:1776 weakly suppresses
- L0:1618 weakly excites
- L17:872 weakly excites
- L16:1668 weakly suppresses
- L3:2155 weakly excites
- L1:1956 weakly excites
- L0:2267 weakly excites
- L8:2842 weakly excites
- L10:343 weakly excites
- L4:911 weakly suppresses
- L4:2078 weakly excites
- L8:2567 weakly suppresses
Feeds later layers
- L19:879 excites
- L19:2848 weakly excites
- L22:2435 weakly excites
- L22:945 weakly suppresses
- L27:1988 weakly suppresses
- L21:815 weakly suppresses
- L21:2809 weakly excites
- L20:2305 weakly excites
- L23:2193 weakly suppresses
- L20:1085 weakly suppresses
- L25:1435 weakly excites
- L27:2678 weakly suppresses
- L21:672 weakly suppresses
- L23:2731 weakly excites
- L20:441 weakly excites
- L19:453 weakly suppresses
- L25:1115 weakly excites
- L24:2486 weakly excites
- L19:624 weakly excites
- L23:1661 weakly suppresses
- L24:197 weakly excites
- L23:2855 weakly excites
- L22:2460 weakly excites
- L21:1745 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- antar
- 考える
- insula
- pires
- ению
- ento
- ニック
- ees
- ималь
- ñas
Suppresses
- 痿
- withheld
- ynet
- oku
- cass
- stime
- getChild
- 人都
- held
- olph