Neuron Explorer

Qwen3-0.6B

spot right before a citation year

A neuron in layer 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the gap or bracket right before the year in a scientific reference, like "et al. (2002)" or "Beggs et al., 2011". It is a very clear pattern in the examples. Turning it up or down gave text that did not clearly relate to citations.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    , L. (2011). Psychopharmacology demystified. Clifton Park

  2. #2 peak

    et al. 2002). Others believe that there are no more than 4,

  3. #3 peak

    L., Allison, A. & James, R. 2016. Dorcopsis atrata. The IUCN Red

  4. #4 peak

    x et al., 2012). Floral humidity is created by a combination of nectar evaporation and floral transpiration (Azad et al., 2007; Corbet et al., 1979;

  5. #5 peak

    uce (c. 70 years old) trees at the opposing sides of the plot (Figure 1a, for details see Grams et al. 2021). Six plots were equipped with roofs and assigned to throughfall

  6. #6 peak

    ateral view). Both are from the Late Intermediate Period component at the Vegachayoq Moqo sector at Huari (photo from Taung et al. 2016, figure 10.4, page 20

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I just want to know what the the the the the the the the the the the the the the the the the the the [1414141414141414141414

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    his compositions like ‘raṅgapuravihara,’ ‘jambṅpate māih pāhi,’ and ‘akhilāṇ- ḍeśvari.’⏎Muddusvāmi Dikṣ

  2. #2 peak

    The Agency. A סוֹכֵן(male) or סוֹכֶנֶת(female) is an agent, so

  3. #3 peak

    : to feel, wake up 晓 : dawn⏎Meaning for Lien 2 处 : place 闻 : hear 啼 : cry 茑 : bird⏎Meaning for Line 3 夜 : night 来

  4. #4 peak

    world.⏎Sufism, or Taṣawwuf ( الْتَّصَوُّف; صُوفِيّ ṣūfiyy / ṣūfī, مُتَ

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L9:7 excites
  2. L10:33 suppresses
  3. L1:108 suppresses
  4. L0:324 suppresses
  5. L3:69 excites
  6. L5:34 excites
  7. L8:30 excites blank slot right before a number
  8. L12:5 excites
  9. L0:2098 excites
  10. L10:105 suppresses
  11. L12:2995 excites
  12. L4:53 excites blank slot before a number
  13. L11:226 weakly suppresses
  14. L6:0 weakly excites
  15. L12:187 weakly suppresses
  16. L6:293 weakly suppresses
  17. L8:94 weakly suppresses
  18. L4:2990 weakly excites
  19. L12:2051 weakly excites sentence end before a line break
  20. L6:1846 weakly excites
  21. L13:522 weakly excites
  22. L6:1842 weakly suppresses
  23. L5:1848 weakly suppresses comma after 'though' mid-sentence
  24. L4:688 weakly excites "to" after begin or start

Feeds later layers

  1. L23:498 suppresses
  2. L15:286 suppresses
  3. L20:1067 suppresses
  4. L15:123 suppresses
  5. L18:480 suppresses
  6. L19:377 suppresses
  7. L15:364 suppresses
  8. L17:747 weakly excites
  9. L17:1787 weakly suppresses
  10. L21:173 weakly suppresses
  11. L16:1085 weakly suppresses
  12. L20:1897 weakly suppresses
  13. L18:93 weakly suppresses
  14. L22:203 weakly excites
  15. L20:668 weakly suppresses
  16. L15:1648 weakly suppresses
  17. L18:135 weakly excites
  18. L20:1600 weakly suppresses
  19. L16:1046 weakly suppresses
  20. L16:1888 weakly excites
  21. L24:2674 weakly excites
  22. L21:226 weakly excites
  23. L16:369 weakly excites
  24. L21:278 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.85 and -3.671 values between -2.76 and -2.571 values between -2.21 and -2.021 values between -2.02 and -1.841 values between -1.66 and -1.471 values between -1.47 and -1.294 values between -1.11 and -0.921 values between -0.92 and -0.742 values between -0.74 and -0.5612 values between -0.56 and -0.3885 values between -0.38 and -0.19600 values between -0.19 and -0.012062 values between -0.01 and 0.18796 values between 0.18 and 0.36197 values between 0.36 and 0.5488 values between 0.54 and 0.7234 values between 0.72 and 0.9116 values between 0.91 and 1.092 values between 1.09 and 1.271 values between 1.46 and 1.641 values between 2.01 and 2.191 values between 3.29 and 3.47offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 項
  2. fold
  3. reated
  4. odus
  5. جه
  6. 反思
  7. file
  8. 态
  9. unlaw
  10. Dear

Suppresses

  1. icação
  2. gnu
  3. cı
  4. ycin
  5. 告诉她
  6. ulkan
  7. eña
  8. -navigation
  9. мел
  10. ittal