'or' or 'and' joining two items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'or' or 'and' when it joins two parallel things, such as two symptoms, two actions or two nouns in a list. Turning it up did not produce a clear visible theme in the outputs.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
include pelvic or lower abdominal pressure; a persistent, dull ache in the lower back; menstrual-like cramps (with or without diarrhea); a change in the type or amount of vaginal discharge (sometimes a leak or gush of fluid); and regular
-
teleconferencing are made possible with the use of some widely used networking protocols. One of the many fundamental things to know as a network engineer is the function and port number used by a number of common services as well as many that are typically
-
, paying bills, or shopping online from the Federal Deposit Insurance Corporation:⏎1. If you bank online, frequently check your deposit accounts and lines of credit to spot and report errors or fraudulent transactions, just as you do with traditional banking.⏎2.
-
in, a hormone that stimulates milk production.⏎Other causes of galactorrhea include:⏎- Hormonal imbalance⏎Some medications, such as:⏎- Stopping or starting to take birth control pills or other hormones⏎- Certain blood pressure drugs⏎
-
Queen Mary and superintendent of the Hampton Court garden. He published Phytographia in which he described and illustrated more than 2 700 rare exotic plants. He was also
-
ists as Louis XVII but he was never crowned and never ruled in his own right before his own death. The largest of Francis' building projects was the reconstruction and expansion of the Château de Fontainebleau, which quickly became his
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to be my own person, and the focus is on the start of the first few years, as I mentioned something earlier, I need to get the first year of education in the first part of the 90s I was
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
consider the following aspects.⏎- Spelling – Convention⏎The spelling of Chinese words using the Latin alphabet (romanisation) seems to be more art than
-
, a hormone that stimulates milk production.⏎Other causes of galactorrhea include:⏎- Hormonal imbalance⏎Some medications, such as:⏎- Stopping or starting to take birth control pills or other hormones⏎- Certain blood pressure drugs⏎-
-
states to elect Black lawmakers were those in which formerly enslaved Black people continued to be populous: southern states including Mississippi, South Carolina, Florida<|endoftext|>The Symptoms and Treatment of Bipolar Type 2⏎Bipolar type 2 is a bipolar spectrum
-
the Freedom of Information Act 2000;⏎- seek advice as necessary to ensure that the institution does what is right both in the spirit and the letter of the law, recognise a legal problem and understand whether expert advice is required.⏎Who
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:165 suppresses
- L11:1397 suppresses
- L13:2646 excites
- L13:645 suppresses
- L12:2641 suppresses
- L10:1395 excites
- L13:615 suppresses
- L7:669 weakly excites
- L13:2397 weakly excites
- L12:1653 weakly suppresses
- L13:201 weakly excites
- L8:2257 weakly suppresses
- L13:112 weakly suppresses
- L10:894 weakly excites
- L7:2270 weakly suppresses "of" after member, version, or part nouns
- L13:1781 weakly excites
- L3:433 weakly excites
- L13:1659 weakly excites
- L2:29 weakly suppresses
- L2:246 weakly excites
- L1:367 weakly suppresses
- L0:25 weakly excites
- L8:526 weakly suppresses
- L11:1576 weakly excites
Feeds later layers
- L15:2736 excites
- L18:883 excites
- L15:1230 suppresses
- L15:3022 excites 'and' joining parallel objects
- L15:1501 excites "and" joining two parts of a name or phrase
- L17:356 excites
- L15:1474 excites
- L19:1045 excites
- L15:404 suppresses
- L16:247 excites
- L15:631 weakly suppresses
- L15:1234 weakly excites
- L16:347 weakly excites
- L18:517 weakly suppresses
- L27:607 weakly suppresses
- L17:2764 weakly excites
- L24:1481 weakly excites
- L17:2916 weakly suppresses
- L16:961 weakly excites
- L17:1959 weakly excites
- L16:1615 weakly suppresses
- L24:1836 weakly excites
- L16:1077 weakly excites
- L20:2584 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ænd
- orton
- truncate
- abund
- .mag
- ownik
- ency
- olars
- ands
- preferably
Suppresses
- rowsing
- WithValue
- му
- mare
- aturity
- :X
- ptime
- Being
- (effect
- Asia