Neuron Explorer

Qwen3-0.6B

year digits inside 20xx dates

A neuron in layer 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

Fires on the digit in the middle of a year like 2020, 2021 or 2023, the one that tells the decade. Turning it up gave text that did not obviously relate to years, so the link to the pattern is weak in the output.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Antonio vied with each other for trade, commerce and business.⏎George R. Woolfolk⏎Prairie View A&M College⏎Rights© 2021 Prairie View A & M University⏎This work is licensed under a Creative Commons

  2. #2 peak

    . So, you could also argue the Internet (<|endoftext|>このトピックには0件の返信が含まれ、1人の参加者がいます。2020年7月6日 at 9:45 AMに Megan Smith

  3. #3 peak

    This post contains my opinions and is not meant to be taken as medical advice. If you have a medical concern, please consult your personal physician.⏎@2020,<|endoftext|>The global energy system works on timescales of decades rather years.

  4. #4 peak

    the file name for working⏎Example 1: Unzipping files⏎In this example, the .tgz file of Softmaker-free office-2021 is used. let’s first check the .tgz file location and get

  5. #5 peak

    with our community members and organizations to share information with the public on the health benefits and risks linked with eating fish. See our most recent projects below.⏎2020: Asian women of child-bearing age in

  6. #6 peak

    It also offers tips for taking a social media break.⏎Stepping away from social media, even for an indefinite time, has many benefits.⏎A 2020 study found that a fear of missing out, known as FOMO,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have been, as I have, in the time, in the time, as it was, in the time, as it was, in the time, in the time, in the time, in the time, in the time,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    of the European Geriatric Medicine study are available here: http://www.europeangeriaticmedicine.com/article/S1878-7649(13)00123-X/).⏎It is possible nursing staff

  2. #2 peak

    iversity and Conservation (2004) 13: 2511. doi:10.1023/B:BIOC.0000048451.07820.

  3. #3 peak

    Jake Matijevic."⏎- Curiosity on Mars sits on rocks similar to those found in marshes in MexicoTue, 30 Oct 2012, 11:07:11 EDT⏎

  4. #4 peak

    ern at gmail.com⏎Fri Sep 10 00:10:22 CEST 2010⏎On 9/9/10 4:39 PM, Baba wrote:⏎> In below code

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L12:1264 excites gap before a year in dates
  2. L10:1304 suppresses
  3. L3:2963 weakly excites "discrete" and "dispersive" in technical text
  4. L6:1130 weakly suppresses
  5. L2:1096 weakly excites
  6. L14:1700 weakly excites
  7. L1:1235 weakly excites
  8. L4:2472 weakly excites
  9. L11:1848 weakly excites
  10. L2:996 weakly excites
  11. L13:3051 weakly suppresses
  12. L9:2227 weakly suppresses ordinal numbers in military unit names
  13. L9:540 weakly suppresses
  14. L5:600 weakly excites
  15. L0:393 weakly suppresses
  16. L6:1654 weakly suppresses
  17. L2:2805 weakly suppresses
  18. L5:32 weakly suppresses
  19. L12:696 weakly suppresses
  20. L7:1554 weakly excites
  21. L4:2720 weakly excites
  22. L1:461 weakly excites
  23. L7:2028 weakly suppresses
  24. L7:399 weakly suppresses laboratory and research facility terms

Feeds later layers

  1. L24:1213 weakly suppresses
  2. L18:1368 weakly suppresses
  3. L17:2356 weakly suppresses
  4. L22:1435 weakly excites
  5. L18:819 weakly suppresses
  6. L21:2416 weakly excites
  7. L23:449 weakly excites
  8. L16:1161 weakly suppresses
  9. L22:2036 weakly excites
  10. L22:2346 weakly excites
  11. L18:1816 weakly excites
  12. L24:695 weakly suppresses
  13. L26:2186 weakly excites
  14. L20:2196 weakly excites
  15. L19:1753 weakly suppresses
  16. L22:2594 weakly excites
  17. L21:811 weakly excites
  18. L19:2130 weakly excites
  19. L22:1541 weakly suppresses
  20. L21:123 weakly excites
  21. L21:1678 weakly suppresses
  22. L24:1901 weakly suppresses
  23. L17:1757 weakly excites
  24. L17:2474 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -4.55 and -4.342 values between -3.52 and -3.311 values between -3.10 and -2.901 values between -1.86 and -1.662 values between -1.66 and -1.452 values between -1.24 and -1.042 values between -1.04 and -0.8313 values between -0.83 and -0.62191 values between -0.62 and -0.42993 values between -0.42 and -0.211838 values between -0.21 and -0.00751 values between -0.00 and 0.2072 values between 0.20 and 0.4113 values between 0.41 and 0.627 values between 0.62 and 0.824 values between 0.82 and 1.032 values between 1.03 and 1.242 values between 1.24 and 1.442 values between 1.44 and 1.654 values between 1.65 and 1.861 values between 2.27 and 2.481 values between 2.48 and 2.681 values between 3.10 and 3.302 values between 3.51 and 3.72offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. adow
  2. werk
  3. Alpine
  4. Elk
  5. 峦
  6. recomm
  7. 文学
  8. alış
  9. emphasize
  10. fearless

Suppresses

  1. .au
  2. 期内
  3. held
  4. xAA
  5. vase
  6. ipples
  7. erde
  8. nerRadius
  9. >()->
  10. 一艘