'by' after 'characterized' or 'marked'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'by' when it comes after words like 'characterized' or 'marked', as in 'characterized by rapid change'. Its negative side shows up on pieces of longer words such as 'mand-ar-ins'. Turning it up did not give a clear topic in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
when the famed American Barnum & Bailey Circus featuring William Cody, aka Buffalo Bill, visited the city of Ghent. In the spirit of the times, characterized by a romanticized exoticism, the scene of "cowboys" and "Ind
-
New York gallery. This success allowed him to dedicate himself to painting. By the late 1920s, Hopper developed his mature style, characterized by depictions of lonely urban and small town scenes in which there may be only a
-
<|endoftext|>Science & Medicine⏎About the Photo⏎Outdoor yoga class in Karnal, in the state of Haryana⏎Explore the Topic⏎India's history is characterized by extensive scientific contributions and a rich philosophical tradition that integrates science and religion. Archaeological
-
own culture and in the context of our own times.⏎It is indeed a time when we are called and morally obligated to recognize the precarious state of the world characterized by processes and practices that disrupt, endanger and degrade both our social and natural worlds which
-
Of Liquid Water On Red Planet ]<|endoftext|>In the last 100 year, European agriculture suffered significant changes. Beginning of 21st century is marked by a global scarcity of water resources, environmental pollution and increased soil and water salinity
-
to the province was marked by plundering, extortion and the murder of C. Trebonius, procons
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to do some research on a project. The project is running on a server. The server is running on a cloud. I need to do some research. The project is running on a cloud. The project is running on a server
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
mom eats can flavor breast milk for up to 8 hours.⏎Licorice flavor peaked strongly in breast milk two hours after the capsule, as did the caraway seed flavor. Mint appeared in the mom's milk at lower concentrations but peaked much
-
Have a snack supply for the day; e.g. mandarins, apples, bananas, low fat yoghurts, dried fruit,
-
floral with a green note⏎The mandarin tree (Citrus reticulata) is a tree from the Rutaceae family producing citrus fruits called mandarins. The fruit is spherical and slightly flattened, with a diameter of 5
-
ating ceramic substrates), which reduce nitrogen oxides (NOx), and DPFs, which reduce particulate matter (soot).⏎Of course, Corning's substrate and filter technologies have both come a long way since the '70
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:2801 weakly excites
- L1:189 weakly suppresses
- L1:1910 weakly excites
- L1:1960 weakly excites
- L1:388 weakly suppresses
- L1:1029 weakly excites
- L1:146 weakly excites
- L0:1224 weakly suppresses
- L0:1301 weakly suppresses
- L0:178 weakly suppresses
- L1:1583 weakly excites
- L1:2406 weakly suppresses
- L0:196 weakly suppresses
- L1:954 weakly excites "over" in "all over the world"
- L0:1075 weakly excites
- L0:994 weakly suppresses
- L0:504 weakly excites
- L0:1042 weakly suppresses "This" starting a labelled sentence
- L0:1904 weakly excites
- L1:1378 weakly excites
- L1:2922 weakly excites
- L0:840 weakly excites
- L1:1812 weakly suppresses
- L1:2020 weakly excites
Feeds later layers
- L11:512 weakly suppresses
- L12:2599 weakly suppresses
- L24:972 weakly excites
- L6:2174 weakly excites
- L6:1561 weakly excites
- L24:332 weakly suppresses
- L9:1274 weakly suppresses
- L27:2074 weakly excites
- L5:1903 weakly excites
- L21:1726 weakly excites
- L7:1933 weakly excites
- L22:87 weakly excites
- L23:1534 weakly suppresses
- L13:187 weakly suppresses
- L18:2852 weakly suppresses
- L16:1986 weakly excites
- L21:1413 weakly suppresses
- L22:2152 weakly excites
- L7:2974 weakly excites
- L21:2031 weakly suppresses
- L4:1479 weakly excites
- L5:1964 weakly suppresses
- L6:1809 weakly excites
- L16:1208 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- yses
- Ữ
- lua
- alent
- ural
- .lineWidth
- idente
- ota
- yll
- →lua
Suppresses
- 红旗
- thuyền
- ikers
- epid
- wort
- 共青
- ič
- rif
- compagn
- Grün