"and" in lists of three or more
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron lights up on the word "and" when it joins the last two items in a list, such as "planting, and watering" or "liquor, cosmetics, and cigarettes". When it is turned up, the model writes wandering, repetitive phrases. Turned down, it also drifts, so the steering results do not show a clear meaning.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
allet basis. Easy access encouraged the theft of electronics, appliances, clothes, engine parts, liquor, cosmetics, and cigarettes from terminals (including warehouses, docks, and transfer points) and during loading, unloading, and shipment.⏎During the
-
levels of vitamins E, D, and dietary fiber. Eaten on a regular basis, vegetables have a dramatic effect on
-
of a small western Maine community north of Farmington as told by a team consisting of Strong Historical Society, Strong Elementary School, and Strong Public Library. Exhibit topics include Strong's prominence in the wood products industry (
-
in the school kitchen and offered to students at lunchtime or during one of the school’s monthly events called Tasting Tuesday.⏎After all the digging, planting, and watering students will have done over the summer, most will rush to the front of
-
a global Dominican mission is effectual when contributing to the development of the local Church within the context of a globalized world. As Dominican sisters, friars, and lay people, we are called to reformulate the fruits of our tradition<|endoftext|>There
-
. It’s a common phrase used for a myriad of symptoms affecting your ability to think. Brain fog can include things like memory problems, lack of mental clarity, and an inability to focus, and put thoughts into words. Some people describe it as
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately, and I have been thinking about lately, and I have been thinking about lately, and I have been thinking about lately, and I have been thinking about lately, and I have been thinking about lately, and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
<BR>Sun Certified Programmer for the Java <|endoftext|>Australia takes about 13 000 refugees per year, about one-third each from Africa, the Middle East and the Asia/Pacific region.1 The majority have had diets of
-
of Idaho students in grades 4, 8, and 12 every year, in different subjects each year. NA
-
since the country started planting the first insect resistant cotton seeds. According to ISAAA, Kenya is expected to join the league of biotech countries such as India, the USA, China, Pakistan, and Brazil in growing Bt cotton and marketing its
-
, decrees and laws the Lord your God directed me to teach you to observe in the land that you are crossing the Jordan to possess, so that you, your children and their children after them may fear the Lord your God as long as you
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:1356 excites
- L5:1469 suppresses
- L3:433 weakly suppresses
- L5:1205 weakly excites
- L2:66 weakly excites
- L5:2541 weakly suppresses "layer" in thin layer or ozone layer
- L5:1281 weakly suppresses
- L5:734 weakly suppresses
- L4:842 weakly suppresses
- L2:249 weakly suppresses
- L4:811 weakly suppresses
- L4:1473 weakly excites
- L2:2244 weakly excites
- L2:2678 weakly excites
- L0:1785 weakly suppresses
- L1:405 weakly suppresses
- L5:101 weakly excites
- L1:1102 weakly suppresses
- L5:359 weakly suppresses
- L2:992 weakly suppresses
- L5:1686 weakly suppresses the word 'tropical'
- L5:352 weakly excites
- L4:91 weakly suppresses
- L1:2486 weakly excites
Feeds later layers
- L16:2577 suppresses
- L14:1116 excites 'and' inside lists
- L17:2221 suppresses
- L14:2054 suppresses
- L16:2442 excites
- L12:1235 suppresses commas inside numbers and lists
- L13:1066 suppresses
- L20:1856 suppresses
- L10:838 suppresses comma in a list of paired nouns
- L11:876 excites 'other' after 'among' in lists
- L7:42 suppresses
- L9:216 suppresses
- L7:1223 suppresses "and" joining two decades or times
- L16:2329 suppresses
- L9:77 suppresses commas in citations and name lists
- L26:347 suppresses the 're' in self-reliant and similar
- L10:667 suppresses commas inside lists of names
- L8:593 suppresses
- L10:74 excites
- L10:782 suppresses
- L8:1047 excites
- L13:977 suppresses
- L16:846 weakly suppresses comma opening an aside or explanation
- L16:1669 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- UserCode
- ıldığı
- opher
- xmm
- icit
- ittance
- edere
- bersome
- emic
- ESIS
Suppresses
- 管理和
- 和完善
- and
- +')
- 和支持
- 以及
- 建设和
- qrstuvwxyz
- 文化和
- および