Neuron Explorer

Qwen3-0.6B

'by' after 'characterized' or 'marked'

A neuron in layer 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'by' when it comes after words like 'characterized' or 'marked', as in 'characterized by rapid change'. Its negative side shows up on pieces of longer words such as 'mand-ar-ins'. Turning it up did not give a clear topic in the output.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    when the famed American Barnum & Bailey Circus featuring William Cody, aka Buffalo Bill, visited the city of Ghent. In the spirit of the times, characterized by a romanticized exoticism, the scene of "cowboys" and "Ind

  2. #2 peak

    New York gallery. This success allowed him to dedicate himself to painting. By the late 1920s, Hopper developed his mature style, characterized by depictions of lonely urban and small town scenes in which there may be only a

  3. #3 peak

    <|endoftext|>Science & Medicine⏎About the Photo⏎Outdoor yoga class in Karnal, in the state of Haryana⏎Explore the Topic⏎India's history is characterized by extensive scientific contributions and a rich philosophical tradition that integrates science and religion. Archaeological

  4. #4 peak

    own culture and in the context of our own times.⏎It is indeed a time when we are called and morally obligated to recognize the precarious state of the world characterized by processes and practices that disrupt, endanger and degrade both our social and natural worlds which

  5. #5 peak

    Of Liquid Water On Red Planet ]<|endoftext|>In the last 100 year, European agriculture suffered significant changes. Beginning of 21st century is marked by a global scarcity of water resources, environmental pollution and increased soil and water salinity

  6. #6 peak

    to the province was marked by plundering, extortion and the murder of C. Trebonius, procons

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I need to do some research on a project. The project is running on a server. The server is running on a cloud. I need to do some research. The project is running on a cloud. The project is running on a server

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    mom eats can flavor breast milk for up to 8 hours.⏎Licorice flavor peaked strongly in breast milk two hours after the capsule, as did the caraway seed flavor. Mint appeared in the mom's milk at lower concentrations but peaked much

  2. #2 peak

    Have a snack supply for the day; e.g. mandarins, apples, bananas, low fat yoghurts, dried fruit,

  3. #3 peak

    floral with a green note⏎The mandarin tree (Citrus reticulata) is a tree from the Rutaceae family producing citrus fruits called mandarins. The fruit is spherical and slightly flattened, with a diameter of 5

  4. #4 peak

    ating ceramic substrates), which reduce nitrogen oxides (NOx), and DPFs, which reduce particulate matter (soot).⏎Of course, Corning's substrate and filter technologies have both come a long way since the '70

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L1:2801 weakly excites
  2. L1:189 weakly suppresses
  3. L1:1910 weakly excites
  4. L1:1960 weakly excites
  5. L1:388 weakly suppresses
  6. L1:1029 weakly excites
  7. L1:146 weakly excites
  8. L0:1224 weakly suppresses
  9. L0:1301 weakly suppresses
  10. L0:178 weakly suppresses
  11. L1:1583 weakly excites
  12. L1:2406 weakly suppresses
  13. L0:196 weakly suppresses
  14. L1:954 weakly excites "over" in "all over the world"
  15. L0:1075 weakly excites
  16. L0:994 weakly suppresses
  17. L0:504 weakly excites
  18. L0:1042 weakly suppresses "This" starting a labelled sentence
  19. L0:1904 weakly excites
  20. L1:1378 weakly excites
  21. L1:2922 weakly excites
  22. L0:840 weakly excites
  23. L1:1812 weakly suppresses
  24. L1:2020 weakly excites

Feeds later layers

  1. L11:512 weakly suppresses
  2. L12:2599 weakly suppresses
  3. L24:972 weakly excites
  4. L6:2174 weakly excites
  5. L6:1561 weakly excites
  6. L24:332 weakly suppresses
  7. L9:1274 weakly suppresses
  8. L27:2074 weakly excites
  9. L5:1903 weakly excites
  10. L21:1726 weakly excites
  11. L7:1933 weakly excites
  12. L22:87 weakly excites
  13. L23:1534 weakly suppresses
  14. L13:187 weakly suppresses
  15. L18:2852 weakly suppresses
  16. L16:1986 weakly excites
  17. L21:1413 weakly suppresses
  18. L22:2152 weakly excites
  19. L7:2974 weakly excites
  20. L21:2031 weakly suppresses
  21. L4:1479 weakly excites
  22. L5:1964 weakly suppresses
  23. L6:1809 weakly excites
  24. L16:1208 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.20 and -1.121 values between -1.05 and -0.972 values between -0.75 and -0.681 values between -0.61 and -0.532 values between -0.46 and -0.3810 values between -0.38 and -0.3142 values between -0.31 and -0.24108 values between -0.24 and -0.16303 values between -0.16 and -0.091068 values between -0.09 and -0.021859 values between -0.02 and 0.06376 values between 0.06 and 0.1396 values between 0.13 and 0.2124 values between 0.21 and 0.289 values between 0.28 and 0.352 values between 0.43 and 0.501 values between 0.58 and 0.651 values between 1.09 and 1.171 values between 1.17 and 1.241 values between 1.68 and 1.76offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. yses
  2. Ữ
  3. lua
  4. alent
  5. ural
  6. .lineWidth
  7. idente
  8. ota
  9. yll
  10. →lua

Suppresses

  1. 红旗
  2. thuyền
  3. ikers
  4. epid
  5. wort
  6. 共青
  7. ič
  8. rif
  9. compagn
  10. Grün